Feb 27 01:56:48 devstack cinder-volume[73335]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73335) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 01:56:48 devstack cinder-volume[73335]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73335) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 01:56:48 devstack cinder-volume[73335]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73335) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 01:56:49 devstack cinder-volume[73335]: INFO dbcounter [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Registered counter for database cinder Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG oslo_db.sqlalchemy.engines [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73335) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG dbcounter [-] [73335] Writer thread running {{(pid=73335) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 01:56:49 devstack cinder-volume[73335]: INFO cinder.rpc [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 01:56:49 devstack cinder-volume[73335]: INFO cinder.rpc [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG oslo_db.sqlalchemy.engines [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73335) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:56:49 devstack cinder-volume[73335]: INFO cinder.volume.manager [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Determined volume DB was empty at startup. Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG cinder.volume.manager [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73335) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 01:56:49 devstack cinder-volume[73335]: INFO cinder.volume.manager [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 27 01:56:49 devstack cinder-volume[73335]: WARNING stevedore.named [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 01:56:49 devstack cinder-volume[73335]: WARNING castellan.key_manager [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 01:56:49 devstack cinder-volume[73335]: WARNING cinder.keymgr.conf_key_mgr [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG cinder.volume.drivers.lvm [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73335) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG oslo_concurrency.processutils [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73335) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG oslo_concurrency.processutils [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] CMD "cinder-rtstool verify" returned: 0 in 0.228s {{(pid=73335) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG oslo_db.sqlalchemy.engines [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73335) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:56:49 devstack cinder-volume[73335]: INFO cinder.rpc [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Feb 27 01:56:49 devstack cinder-volume[73335]: INFO cinder.rpc [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Feb 27 01:56:49 devstack cinder-volume[73335]: WARNING stevedore.named [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 01:56:49 devstack cinder-volume[73335]: WARNING castellan.key_manager [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 01:56:49 devstack cinder-volume[73335]: INFO cinder.volume.manager [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG oslo_db.sqlalchemy.engines [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73335) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:56:49 devstack cinder-volume[73335]: INFO oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Starting 1 workers Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Started child 73437 {{(pid=73335) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Full set of CONF: {{(pid=73335) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] ******************************************************************************** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Configuration options gathered from: {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 01:56:49 devstack cinder-volume[73437]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] ================================================================================ {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] allow_availability_zone_fallback = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] allow_compression_on_image_upload = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] allowed_direct_url_schemes = [] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] api_rate_limit = True {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] auth_strategy = keystone {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] az_cache_duration = 3600 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:49 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_availability_zone = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_host = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_name = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_stats_polling_interval = 60 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backup_api_class = cinder.backup.api.API {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backup_name_template = backup-%s {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backup_use_same_host = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backup_use_temp_snapshot = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] chap_password = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] chap_username = {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cinder_internal_tenant_project_id = e6b647c3a074494cb424422a9d74cb28 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cinder_internal_tenant_user_id = f21ebf34b9d04ea088ea94aec6cac3c0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cloned_volume_same_az = True {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cluster = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] compression_format = gzip {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] compute_api_class = cinder.compute.nova.API {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] config_dir = [] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] config_source = [] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] control_exchange = openstack {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] debug = True {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] default_availability_zone = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] default_group_type = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] default_volume_type = lvmdriver-1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] disk_geometry = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] driver_client_cert = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] driver_client_cert_key = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] driver_data_namespace = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] driver_ssl_cert_path = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] driver_ssl_cert_verify = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] driver_use_ssl = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] enable_force_upload = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] enable_new_services = True {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] enable_unsupported_driver = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] enabled_backends = ['lvmdriver-1'] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] enforce_multipath_for_image_xfer = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] filter_function = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] glance_api_insecure = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] glance_api_servers = ['http://192.168.122.156/image'] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] glance_api_ssl_compression = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] glance_ca_certificates_file = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] glance_catalog_info = image:glance:publicURL {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73437]: INFO cinder.volume.manager [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Starting volume driver LVMVolumeDriver (3.0.0) Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] glance_certfile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] glance_keyfile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] glance_num_retries = 3 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] glance_request_timeout = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] goodness_function = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] graceful_shutdown_timeout = 5 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] group_api_class = cinder.group.api.API {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] host = devstack {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] image_compress_on_upload = True {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] image_conversion_address_space_limit = 1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] image_conversion_cpu_limit = 60 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] image_conversion_disable = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] image_upload_use_cinder_backend = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] image_upload_use_internal_tenant = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] image_volume_cache_enabled = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] image_volume_cache_max_count = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] image_volume_cache_max_size_gb = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] init_host_max_objects_retrieval = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] instance_format = [instance: %(uuid)s] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] iscsi_target_flags = {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] iscsi_write_cache = on {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] iser_helper = tgtadm {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] iser_ip_address = 192.168.122.156 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] iser_port = 3260 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] log_color = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] log_config_append = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] log_dir = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] log_file = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] log_options = True {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] log_rotate_interval = 1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] log_rotate_interval_type = days {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] log_rotation_type = none {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] max_age = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] max_logfile_count = 30 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] max_logfile_size_mb = 200 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] max_over_subscription_ratio = 20.0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] message_reap_interval = 86400 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] message_ttl = 2592000 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] migration_create_volume_timeout_secs = 300 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] monkey_patch = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] monkey_patch_modules = [] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] my_ip = 192.168.122.156 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] no_snapshot_gb_quota = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] num_iser_scan_tries = 3 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] num_shell_tries = 3 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] num_volume_device_scan_tries = 3 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] nvmeof_conn_info_version = 1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] nvmet_ns_id = 10 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] nvmet_port_id = 1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] osapi_max_limit = 1000 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] osapi_volume_ext_list = [] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] osapi_volume_listen = 0.0.0.0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] osapi_volume_listen_port = 8776 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] osapi_volume_use_ssl = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] osapi_volume_workers = 2 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] per_volume_size_limit = -1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] periodic_fuzzy_delay = 60 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] periodic_interval = 60 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] project_id_regex = [0-9a-f\-]+ {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] public_endpoint = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] publish_errors = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] quota_backup_gigabytes = 1000 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] quota_backups = 10 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] quota_gigabytes = 1000 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] quota_groups = 10 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] quota_snapshots = 10 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] quota_volumes = 10 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] rate_limit_burst = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] rate_limit_except_level = CRITICAL {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] rate_limit_interval = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] reinit_driver_count = 3 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] replication_device = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] report_discard_supported = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] report_interval = 120 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] reservation_clean_interval = 86400 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] reservation_expire = 86400 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] reserved_image_namespaces = [] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] reserved_percentage = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] rpc_response_timeout = 120 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] run_external_periodic_tasks = True {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] scst_target_driver = iscsi {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] scst_target_iqn_name = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] service_down_time = 720 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] shell_completion = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] snapshot_name_template = snapshot-%s {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] snapshot_same_host = True {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] split_loggers = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] state_path = /opt/stack/data/cinder {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] storage_availability_zone = nova {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] storage_protocol = iSCSI {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] syslog_log_facility = LOG_USER {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] target_helper = lioadm {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] target_ip_address = 192.168.122.156 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] target_port = 3260 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] target_protocol = iscsi {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] target_secondary_ip_addresses = [] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] trace_flags = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] transfer_api_class = cinder.transfer.api.API {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] transport_url = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] until_refresh = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] use_chap_auth = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] use_default_quota_class = True {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] use_journal = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] use_json = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] use_multipath_for_image_xfer = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] use_stderr = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] use_syslog = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] verify_glance_signatures = enabled {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] volume_api_class = cinder.volume.api.API {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] volume_backend_name = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] volume_clear = zero {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] volume_clear_ionice = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] volume_clear_size = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] volume_copy_bps_limit = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] volume_dd_blocksize = 1M {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] volume_name_template = volume-%s {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] volume_service_inithost_offload = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] volume_usage_audit_period = month {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] zoning_mode = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:50 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_concurrency.disable_process_locking = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.admin_password = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.admin_token = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.admin_user = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.auth_admin_prefix = {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.auth_port = 35357 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.auth_protocol = https {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.auth_section = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.auth_type = password {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.auth_uri = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.auth_version = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.cache = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.certfile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.identity_uri = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.include_service_catalog = True {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.insecure = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.interface = public {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.keyfile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.memcache_password = {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.memcache_username = {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.region_name = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.service_type = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.156/identity {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.backend = dogpile.cache.null {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack sudo[73441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.backend_argument = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack sudo[73441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.backend_expiration_time = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.config_prefix = cache.oslo {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.debug_cache_backend = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.enable_retry_client = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.enable_socket_keepalive = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.enabled = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.enforce_fips_mode = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.expiration_time = 600 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.hashclient_retry_attempts = 2 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.memcache_dead_retry = 300 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.memcache_pool_maxsize = 10 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.memcache_sasl_enabled = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.password = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.proxies = [] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.redis_db = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.redis_sentinel_service_name = mymaster {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.redis_server = localhost:6379 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.retry_attempts = 2 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.retry_delay = 0.0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.socket_keepalive_count = 1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.socket_keepalive_idle = 1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.socket_keepalive_interval = 1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.socket_timeout = 1.0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.tls_allowed_ciphers = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.tls_cafile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.tls_certfile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.tls_enabled = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.tls_keyfile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cache.username = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] coordination.backend_url = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.asyncio_connection = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.asyncio_slave_connection = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.backend = sqlalchemy {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.connection = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.connection_debug = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.connection_parameters = {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.connection_recycle_time = 3600 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.connection_trace = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.db_inc_retry_interval = True {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.db_max_retries = 20 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.db_max_retry_interval = 10 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.db_retry_interval = 1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.max_overflow = 50 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.max_pool_size = 5 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.max_retries = 10 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.mysql_wsrep_sync_wait = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.pool_timeout = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.retry_interval = 10 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.slave_connection = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.sqlite_synchronous = True {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.synchronous_reader = True {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] database.use_db_reconnect = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] profiler.connection_string = messaging:// {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] profiler.enabled = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] profiler.es_doc_type = notification {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] profiler.es_scroll_size = 10000 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] profiler.es_scroll_time = 2m {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] profiler.filter_error_trace = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] profiler.hmac_keys = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] profiler.sentinel_service_name = mymaster {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] profiler.socket_timeout = 0.1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] profiler.trace_requests = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] profiler.trace_sqlalchemy = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] profiler_jaeger.process_tags = {} {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] profiler_jaeger.service_name_prefix = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] profiler_otlp.service_name_prefix = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_policy.enforce_new_defaults = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: WARNING oslo_config.cfg [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_policy.enforce_scope = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_policy.policy_default_rule = default {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_policy.policy_file = policy.yaml {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_policy.remote_timeout = 60.0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] privsep_osbrick.group = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] privsep_osbrick.helper_command = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] privsep_osbrick.user = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cinder_sys_admin.group = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cinder_sys_admin.helper_command = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] cinder_sys_admin.user = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] service_user.auth_section = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] service_user.auth_type = password {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] service_user.cafile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] service_user.certfile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] service_user.collect_timing = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] service_user.insecure = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] service_user.keyfile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] service_user.send_service_user_token = True {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] service_user.split_loggers = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] service_user.timeout = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] glance.auth_section = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] glance.auth_type = password {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] glance.certfile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] glance.collect_timing = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] glance.insecure = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] glance.keyfile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] glance.region_name = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] glance.split_loggers = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] glance.timeout = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.backend_availability_zone = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.chap_password = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.chap_username = {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.disk_geometry = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.driver_client_cert = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.driver_client_cert_key = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.driver_data_namespace = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.driver_use_ssl = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.extra_capabilities = {} {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.filter_function = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.goodness_function = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.iscsi_target_flags = {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.iscsi_write_cache = on {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.iser_helper = tgtadm {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.iser_ip_address = 192.168.122.156 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.iser_port = 3260 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.lvm_mirrors = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.lvm_share_target = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.lvm_type = auto {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.num_shell_tries = 3 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.replication_device = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.report_discard_supported = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.reserved_percentage = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.target_helper = tgtadm {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.target_ip_address = 192.168.122.156 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.target_port = 3260 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.target_protocol = iscsi {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.trace_flags = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.unique_fqdn_network = True {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.use_chap_auth = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.volume_backend_name = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.volume_clear = zero {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.volume_clear_ionice = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.volume_clear_size = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.volume_group = cinder-volumes {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_reports.file_event_handler = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_reports.log_dir = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.backend_availability_zone = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.backend_host = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.chap_password = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.chap_username = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.chiscsi_conf = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.disk_geometry = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.driver_client_cert = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.driver_data_namespace = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.driver_use_ssl = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.extra_capabilities = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.filter_function = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.goodness_function = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.iser_helper = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.iser_ip_address = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.iser_port = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.iser_target_prefix = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.lvm_conf_file = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.lvm_mirrors = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.lvm_share_target = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.lvm_type = auto {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.num_shell_tries = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.nvmet_port_id = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.replication_device = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.report_discard_supported = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.reserved_percentage = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.scst_target_driver = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.storage_protocol = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.target_helper = lioadm {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.target_ip_address = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.target_port = 3260 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.target_protocol = iscsi {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.trace_flags = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.use_chap_auth = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.volume_clear = zero {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.volume_clear_size = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] lvmdriver-1.volumes_dir = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.ssl = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.ssl_version = {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_notifications.driver = [] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_notifications.retry = -1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] key_manager.fixed_key = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican.barbican_api_version = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican.barbican_endpoint = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican.barbican_endpoint_type = public {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican.barbican_region_name = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican.cafile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican.certfile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican.collect_timing = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican.insecure = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican.keyfile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican.number_of_retries = 60 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican.retry_delay = 1 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican.send_service_user_token = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican.split_loggers = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican.timeout = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican.verify_ssl = True {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican.verify_ssl_path = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican_service_user.auth_section = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican_service_user.auth_type = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican_service_user.cafile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican_service_user.certfile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican_service_user.collect_timing = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican_service_user.insecure = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican_service_user.keyfile = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican_service_user.split_loggers = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] barbican_service_user.timeout = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] vault.approle_role_id = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] vault.approle_secret_id = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] vault.kv_mountpoint = secret {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] vault.kv_path = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] vault.kv_version = 2 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] vault.namespace = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] vault.root_token_id = **** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] vault.ssl_ca_crt_file = None {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] vault.timeout = 60.0 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] vault.use_ssl = False {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:50 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] ******************************************************************************** {{(pid=73335) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 01:56:50 devstack sudo[73441]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:50 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.578s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:50 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:50 devstack sudo[73610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:50 devstack sudo[73610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:51 devstack sudo[73610]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:51 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.518s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:51 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 01:56:51 devstack cinder-volume[73437]: INFO cinder.brick.local_dev.lvm [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Feb 27 01:56:51 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:51 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:51 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:51 devstack sudo[73831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:56:51 devstack sudo[73831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:51 devstack sudo[73831]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:51 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.585s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:51 devstack cinder-volume[73437]: DEBUG cinder.brick.local_dev.lvm [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73437) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Feb 27 01:56:51 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:51 devstack sudo[73958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:51 devstack sudo[73958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:52 devstack sudo[73958]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:52 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.792s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:52 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:52 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:52 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:52 devstack sudo[74107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:52 devstack sudo[74107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:53 devstack sudo[74107]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:53 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.461s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:53 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:53 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:53 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:53 devstack sudo[74127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Feb 27 01:56:53 devstack sudo[74127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:53 devstack sudo[74127]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:53 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.430s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:53 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:53 devstack sudo[74131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:56:53 devstack sudo[74131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:53 devstack sudo[74131]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:53 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:53 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:54 devstack sudo[74137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:56:54 devstack sudo[74137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:54 devstack sudo[74137]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:54 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:54 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:54 devstack sudo[74140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:56:54 devstack sudo[74140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:54 devstack sudo[74140]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:54 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:54 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:54 devstack sudo[74148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:54 devstack sudo[74148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:55 devstack sudo[74148]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:55 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.435s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:55 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:55 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:55 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:55 devstack sudo[74152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:55 devstack sudo[74152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:55 devstack sudo[74152]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:55 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.431s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:55 devstack cinder-volume[73437]: INFO cinder.volume.drivers.lvm [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Enabling LVM thin provisioning by default because a thin pool exists. Feb 27 01:56:55 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:55 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:55 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:55 devstack sudo[74159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:55 devstack sudo[74159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:56 devstack sudo[74159]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:56 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.521s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:56 devstack cinder-volume[73437]: DEBUG cinder.volume.drivers.lvm [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Updating volume stats {{(pid=73437) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:56:56 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:56 devstack sudo[74274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:56:56 devstack sudo[74274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:56 devstack sudo[74274]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:56 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:56 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:56 devstack sudo[74345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:56:56 devstack sudo[74345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:57 devstack sudo[74345]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:57 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:57 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:57 devstack sudo[74418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:57 devstack sudo[74418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:57 devstack sudo[74418]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:57 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.491s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:57 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:57 devstack sudo[74422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:56:57 devstack sudo[74422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:58 devstack sudo[74422]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:58 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.497s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:58 devstack cinder-volume[73437]: INFO cinder.volume.driver [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Driver hasn't implemented _init_vendor_properties() Feb 27 01:56:58 devstack cinder-volume[73437]: DEBUG cinder.volume.driver [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73437) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 01:56:58 devstack cinder-volume[73437]: DEBUG oslo_db.sqlalchemy.engines [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73437) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:56:58 devstack cinder-volume[73437]: DEBUG dbcounter [-] [73437] Writer thread running {{(pid=73437) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 01:56:58 devstack cinder-volume[73437]: DEBUG cinder.db.sqlalchemy.api [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Building query based on filter {{(pid=73437) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 01:56:58 devstack cinder-volume[73437]: DEBUG cinder.image.image_utils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73437) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 01:56:58 devstack cinder-volume[73437]: INFO cinder.keymgr.migration [None req-5a2b083e-852a-4e3b-9bb4-019459281475 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 01:56:58 devstack cinder-volume[73437]: DEBUG cinder.volume.drivers.lvm [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Updating volume stats {{(pid=73437) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:56:58 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:58 devstack sudo[74427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:56:58 devstack sudo[74427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:58 devstack sudo[74427]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:58 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.508s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:58 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:58 devstack sudo[74433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:56:58 devstack sudo[74433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:59 devstack sudo[74433]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:59 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.481s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:59 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:59 devstack sudo[74436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:59 devstack sudo[74436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:59 devstack sudo[74436]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:59 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.470s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:59 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:59 devstack sudo[74441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:56:59 devstack sudo[74441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:59 devstack cinder-volume[73335]: DEBUG dbcounter [-] [73335] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73335) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 01:57:00 devstack sudo[74441]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:00 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.556s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:00 devstack cinder-volume[73437]: DEBUG cinder.manager [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Notifying Schedulers of capabilities ... {{(pid=73437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 01:57:00 devstack cinder-volume[73437]: INFO cinder.volume.manager [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Driver initialization completed successfully. Feb 27 01:57:00 devstack cinder-volume[73437]: INFO cinder.manager [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Initiating service 2 cleanup Feb 27 01:57:00 devstack cinder-volume[73437]: INFO cinder.manager [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Service 2 cleanup completed. Feb 27 01:57:00 devstack cinder-volume[73437]: DEBUG cinder.service [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Creating RPC server for service cinder-volume {{(pid=73437) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 01:57:00 devstack cinder-volume[73437]: DEBUG cinder.service [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73437) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 01:57:00 devstack cinder-volume[73437]: INFO cinder.volume.manager [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Feb 27 01:57:00 devstack cinder-volume[73437]: DEBUG cinder.volume.drivers.lvm [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Updating volume stats {{(pid=73437) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:57:00 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:00 devstack sudo[74447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:57:00 devstack sudo[74447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:00 devstack sudo[74447]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:00 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:00 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:00 devstack sudo[74453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:57:00 devstack sudo[74453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:01 devstack sudo[74453]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:01 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.415s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:01 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:01 devstack sudo[74510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:57:01 devstack sudo[74510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:01 devstack sudo[74510]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:01 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.438s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:01 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:01 devstack sudo[74513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:57:01 devstack sudo[74513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:02 devstack sudo[74513]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:02 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:02 devstack cinder-volume[73437]: INFO cinder.volume.manager [None req-2d5d35c2-5fcb-4caa-be50-659860f9fe85 None None] Driver post RPC initialization completed successfully. Feb 27 01:57:12 devstack cinder-volume[73437]: DEBUG dbcounter [-] [73437] Writing DB stats cinder:SELECT=4 {{(pid=73437) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 01:57:12 devstack cinder-volume[73437]: DEBUG dbcounter [-] [73437] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=73437) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 01:58:49 devstack cinder-volume[73437]: DEBUG oslo_service.periodic_task [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73437) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 01:58:49 devstack cinder-volume[73437]: DEBUG cinder.volume.drivers.lvm [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] Updating volume stats {{(pid=73437) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:58:49 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:49 devstack sudo[79697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:58:49 devstack sudo[79697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:49 devstack sudo[79697]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:49 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:49 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:49 devstack sudo[79700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:58:49 devstack sudo[79700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:50 devstack sudo[79700]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:50 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:50 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:50 devstack sudo[79703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:58:50 devstack sudo[79703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:50 devstack sudo[79703]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:50 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.458s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:50 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:50 devstack sudo[79706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:58:50 devstack sudo[79706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:50 devstack sudo[79706]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:50 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.426s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:50 devstack cinder-volume[73437]: DEBUG cinder.manager [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] Notifying Schedulers of capabilities ... {{(pid=73437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 01:59:12 devstack cinder-volume[73437]: DEBUG dbcounter [-] [73437] Writing DB stats cinder:SELECT=1 {{(pid=73437) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 01:59:12 devstack cinder-volume[73437]: DEBUG dbcounter [-] [73437] Writing DB stats cinder:UPDATE=1 {{(pid=73437) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 01:59:49 devstack cinder-volume[73437]: DEBUG oslo_service.periodic_task [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73437) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 01:59:49 devstack cinder-volume[73437]: DEBUG cinder.volume.drivers.lvm [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] Updating volume stats {{(pid=73437) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:59:49 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:59:49 devstack sudo[81571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:59:49 devstack sudo[81571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:59:49 devstack sudo[81571]: pam_unix(sudo:session): session closed for user root Feb 27 01:59:49 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:59:49 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:59:49 devstack sudo[81585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:59:49 devstack sudo[81585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:59:50 devstack sudo[81585]: pam_unix(sudo:session): session closed for user root Feb 27 01:59:50 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:59:50 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:59:50 devstack sudo[81588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:59:50 devstack sudo[81588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:59:50 devstack sudo[81588]: pam_unix(sudo:session): session closed for user root Feb 27 01:59:50 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.442s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:59:50 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:59:50 devstack sudo[81592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:59:50 devstack sudo[81592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:59:51 devstack sudo[81592]: pam_unix(sudo:session): session closed for user root Feb 27 01:59:51 devstack cinder-volume[73437]: DEBUG oslo_concurrency.processutils [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=73437) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:59:51 devstack cinder-volume[73437]: DEBUG cinder.manager [None req-6f872a65-d4e0-4a25-965c-c390f98bbd3e None None] Notifying Schedulers of capabilities ... {{(pid=73437) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:00:40 devstack cinder-volume[73335]: INFO oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Caught SIGTERM, stopping children Feb 27 02:00:40 devstack cinder-volume[73335]: DEBUG oslo_concurrency.lockutils [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Acquiring lock "singleton_lock" {{(pid=73335) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:00:40 devstack cinder-volume[73335]: DEBUG oslo_concurrency.lockutils [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Acquired lock "singleton_lock" {{(pid=73335) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:00:40 devstack cinder-volume[73335]: DEBUG oslo_concurrency.lockutils [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Releasing lock "singleton_lock" {{(pid=73335) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:00:40 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Stop services. {{(pid=73335) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 27 02:00:40 devstack cinder-volume[73335]: DEBUG oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Killing children. {{(pid=73335) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 27 02:00:40 devstack cinder-volume[73335]: INFO oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Waiting on 1 children to exit Feb 27 02:00:40 devstack cinder-volume[73437]: DEBUG oslo_concurrency.lockutils [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Acquiring lock "singleton_lock" {{(pid=73437) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:00:40 devstack cinder-volume[73437]: DEBUG oslo_concurrency.lockutils [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Acquired lock "singleton_lock" {{(pid=73437) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:00:40 devstack cinder-volume[73437]: DEBUG oslo_concurrency.lockutils [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Releasing lock "singleton_lock" {{(pid=73437) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:00:40 devstack cinder-volume[73437]: WARNING amqp [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 02:00:40 devstack cinder-volume[73437]: WARNING amqp [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 02:00:40 devstack cinder-volume[73335]: INFO oslo_service.backend._eventlet.service [None req-fcbd3576-471c-43cb-8a9a-25f2edc14581 None None] Child 73437 exited with status 0 Feb 27 02:00:42 devstack cinder-volume[82640]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82640) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:00:42 devstack cinder-volume[82640]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82640) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:00:42 devstack cinder-volume[82640]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82640) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:00:43 devstack cinder-volume[82640]: INFO dbcounter [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Registered counter for database cinder Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_db.sqlalchemy.engines [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82640) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG dbcounter [-] [82640] Writer thread running {{(pid=82640) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 02:00:43 devstack cinder-volume[82640]: INFO cinder.rpc [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 02:00:43 devstack cinder-volume[82640]: INFO cinder.rpc [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_db.sqlalchemy.engines [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82640) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:43 devstack cinder-volume[82640]: INFO cinder.volume.manager [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Determined volume DB was empty at startup. Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG cinder.volume.manager [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82640) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 02:00:43 devstack cinder-volume[82640]: INFO cinder.volume.manager [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 27 02:00:43 devstack cinder-volume[82640]: WARNING stevedore.named [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 02:00:43 devstack cinder-volume[82640]: WARNING castellan.key_manager [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 02:00:43 devstack cinder-volume[82640]: WARNING cinder.keymgr.conf_key_mgr [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 02:00:43 devstack cinder-volume[82640]: INFO cinder.volume.manager [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_db.sqlalchemy.engines [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82640) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:43 devstack cinder-volume[82640]: INFO oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Starting 1 workers Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Started child 82759 {{(pid=82640) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Full set of CONF: {{(pid=82640) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] ******************************************************************************** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Configuration options gathered from: {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] ================================================================================ {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 02:00:43 devstack cinder-volume[82759]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] allow_availability_zone_fallback = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] allow_compression_on_image_upload = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] allowed_direct_url_schemes = [] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] api_rate_limit = True {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] auth_strategy = keystone {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_availability_zone = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_host = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_name = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_stats_polling_interval = 60 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backup_api_class = cinder.backup.api.API {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backup_name_template = backup-%s {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backup_use_same_host = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backup_use_temp_snapshot = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] chap_password = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] chap_username = {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cinder_internal_tenant_project_id = e6b647c3a074494cb424422a9d74cb28 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cinder_internal_tenant_user_id = f21ebf34b9d04ea088ea94aec6cac3c0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cluster = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] compression_format = gzip {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] compute_api_class = cinder.compute.nova.API {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] config_dir = [] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] config_source = [] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] control_exchange = openstack {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] debug = True {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] default_availability_zone = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] default_group_type = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] default_volume_type = QuobyteHD {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] disk_geometry = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] driver_client_cert = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] driver_client_cert_key = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] driver_data_namespace = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] driver_ssl_cert_path = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] driver_ssl_cert_verify = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] driver_use_ssl = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] enable_new_services = True {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] enable_unsupported_driver = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] enabled_backends = ['QuobyteHD'] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] enforce_multipath_for_image_xfer = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] filter_function = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] glance_api_insecure = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] glance_api_servers = ['http://192.168.122.156/image'] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] glance_api_ssl_compression = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] glance_ca_certificates_file = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] glance_catalog_info = image:glance:publicURL {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] glance_certfile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] glance_keyfile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] glance_num_retries = 3 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] glance_request_timeout = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] goodness_function = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] graceful_shutdown_timeout = 5 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] group_api_class = cinder.group.api.API {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] host = devstack {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] image_compress_on_upload = True {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] image_conversion_address_space_limit = 1 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] image_conversion_cpu_limit = 60 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] image_conversion_disable = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] image_upload_use_cinder_backend = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] image_upload_use_internal_tenant = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] image_volume_cache_enabled = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] image_volume_cache_max_count = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82759]: INFO cinder.volume.manager [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Starting volume driver QuobyteDriver (1.1.14) Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] image_volume_cache_max_size_gb = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82759]: DEBUG cinder.volume.drivers.remotefs [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82759) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] init_host_max_objects_retrieval = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] instance_format = [instance: %(uuid)s] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] iscsi_target_flags = {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] iscsi_write_cache = on {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] iser_helper = tgtadm {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] iser_ip_address = 192.168.122.156 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] iser_port = 3260 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] log_color = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] log_config_append = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] log_dir = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] log_file = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] log_options = True {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] log_rotate_interval = 1 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] log_rotate_interval_type = days {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] log_rotation_type = none {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] max_age = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] max_logfile_count = 30 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] max_logfile_size_mb = 200 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] max_over_subscription_ratio = 20.0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] message_reap_interval = 86400 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] message_ttl = 2592000 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] migration_create_volume_timeout_secs = 300 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] monkey_patch = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] monkey_patch_modules = [] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] my_ip = 192.168.122.156 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] no_snapshot_gb_quota = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] num_iser_scan_tries = 3 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] num_shell_tries = 3 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] num_volume_device_scan_tries = 3 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] nvmeof_conn_info_version = 1 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] nvmet_ns_id = 10 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] nvmet_port_id = 1 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] osapi_max_limit = 1000 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] osapi_volume_ext_list = [] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] osapi_volume_listen_port = 8776 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] osapi_volume_use_ssl = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] osapi_volume_workers = 2 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] per_volume_size_limit = -1 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] periodic_fuzzy_delay = 60 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] periodic_interval = 60 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] public_endpoint = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] publish_errors = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] quota_backup_gigabytes = 1000 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] quota_backups = 10 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] quota_gigabytes = 1000 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] quota_groups = 10 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] quota_snapshots = 10 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] quota_volumes = 10 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] rate_limit_burst = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] rate_limit_except_level = CRITICAL {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] rate_limit_interval = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] reinit_driver_count = 3 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] replication_device = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] report_discard_supported = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] report_interval = 120 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] reservation_clean_interval = 86400 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] reservation_expire = 86400 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] reserved_image_namespaces = [] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] reserved_percentage = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] rpc_response_timeout = 120 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] run_external_periodic_tasks = True {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] scst_target_driver = iscsi {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] scst_target_iqn_name = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] service_down_time = 720 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] shell_completion = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] snapshot_name_template = snapshot-%s {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] split_loggers = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] state_path = /opt/stack/data/cinder {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] storage_availability_zone = nova {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] storage_protocol = iSCSI {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] syslog_log_facility = LOG_USER {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] target_helper = lioadm {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] target_ip_address = 192.168.122.156 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] target_port = 3260 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] target_protocol = iscsi {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] target_secondary_ip_addresses = [] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] trace_flags = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] transport_url = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] until_refresh = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] use_chap_auth = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] use_default_quota_class = True {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] use_journal = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] use_json = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] use_multipath_for_image_xfer = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] use_stderr = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] use_syslog = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] verify_glance_signatures = enabled {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] volume_api_class = cinder.volume.api.API {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] volume_backend_name = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] volume_clear = zero {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] volume_clear_ionice = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] volume_clear_size = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] volume_copy_bps_limit = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] volume_dd_blocksize = 1M {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] volume_name_template = volume-%s {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] volume_service_inithost_offload = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] volume_usage_audit_period = month {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] zoning_mode = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_concurrency.disable_process_locking = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.admin_password = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.admin_token = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.admin_user = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.auth_port = 35357 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.auth_protocol = https {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.auth_section = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.auth_type = password {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.auth_uri = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.auth_version = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.cache = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.certfile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82759]: DEBUG cinder.volume.drivers.quobyte [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82759) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82759]: WARNING cinder.volume.drivers.quobyte [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.identity_uri = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.include_service_catalog = True {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.insecure = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.interface = public {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82759]: WARNING cinder.volume.drivers.quobyte [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.keyfile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.memcache_password = {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82759]: DEBUG oslo_concurrency.processutils [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Running cmd (subprocess): mount.quobyte {{(pid=82759) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.memcache_username = {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.region_name = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.service_type = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.156/identity {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.backend = dogpile.cache.null {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.backend_argument = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.backend_expiration_time = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.config_prefix = cache.oslo {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.debug_cache_backend = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.enable_retry_client = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.enable_socket_keepalive = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.enabled = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.enforce_fips_mode = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.expiration_time = 600 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.hashclient_retry_attempts = 2 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.memcache_dead_retry = 300 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.memcache_pool_maxsize = 10 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.memcache_sasl_enabled = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.password = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.proxies = [] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.redis_db = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.redis_server = localhost:6379 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.retry_attempts = 2 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.retry_delay = 0.0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.socket_keepalive_count = 1 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.socket_keepalive_idle = 1 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.socket_keepalive_interval = 1 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.socket_timeout = 1.0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.tls_allowed_ciphers = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.tls_cafile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.tls_certfile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.tls_enabled = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.tls_keyfile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cache.username = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] coordination.backend_url = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.asyncio_connection = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.asyncio_slave_connection = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.backend = sqlalchemy {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.connection = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.connection_debug = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.connection_parameters = {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.connection_recycle_time = 3600 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.connection_trace = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.db_inc_retry_interval = True {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.db_max_retries = 20 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.db_max_retry_interval = 10 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.db_retry_interval = 1 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.max_overflow = 50 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.max_pool_size = 5 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.max_retries = 10 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.mysql_wsrep_sync_wait = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.pool_timeout = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.retry_interval = 10 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.slave_connection = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.sqlite_synchronous = True {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.synchronous_reader = True {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] database.use_db_reconnect = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] profiler.connection_string = messaging:// {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] profiler.enabled = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] profiler.es_doc_type = notification {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] profiler.es_scroll_size = 10000 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] profiler.es_scroll_time = 2m {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] profiler.filter_error_trace = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] profiler.hmac_keys = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] profiler.sentinel_service_name = mymaster {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] profiler.socket_timeout = 0.1 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] profiler.trace_requests = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] profiler.trace_sqlalchemy = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] profiler_jaeger.process_tags = {} {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] profiler_jaeger.service_name_prefix = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] profiler_otlp.service_name_prefix = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_policy.enforce_new_defaults = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: WARNING oslo_config.cfg [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_policy.enforce_scope = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_policy.policy_default_rule = default {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_policy.policy_file = policy.yaml {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] privsep_osbrick.group = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] privsep_osbrick.helper_command = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] privsep_osbrick.user = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cinder_sys_admin.group = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cinder_sys_admin.helper_command = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] cinder_sys_admin.user = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] service_user.auth_section = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] service_user.auth_type = password {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] service_user.cafile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] service_user.certfile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] service_user.collect_timing = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] service_user.insecure = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] service_user.keyfile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] service_user.send_service_user_token = True {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] service_user.split_loggers = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] service_user.timeout = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] glance.auth_section = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] glance.auth_type = password {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] glance.certfile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] glance.collect_timing = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] glance.insecure = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] glance.keyfile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] glance.region_name = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] glance.split_loggers = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] glance.timeout = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.backend_availability_zone = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.chap_password = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.chap_username = {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.disk_geometry = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.driver_client_cert = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.driver_client_cert_key = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.driver_data_namespace = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.driver_use_ssl = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.extra_capabilities = {} {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.filter_function = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.goodness_function = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.iscsi_target_flags = {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.iscsi_write_cache = on {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.iser_helper = tgtadm {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.iser_ip_address = 192.168.122.156 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.iser_port = 3260 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.nas_host = {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.nas_login = admin {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.nas_mount_options = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.nas_password = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.nas_private_key = {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.nas_share_path = {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.num_shell_tries = 3 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.quobyte_volume_url = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.replication_device = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.report_discard_supported = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.reserved_percentage = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.target_helper = tgtadm {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.target_ip_address = 192.168.122.156 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.target_port = 3260 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.target_protocol = iscsi {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.trace_flags = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.unique_fqdn_network = True {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.use_chap_auth = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.volume_backend_name = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.volume_clear = zero {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.volume_clear_ionice = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack quobyte-client[82760]: Reading configuration file: /etc/quobyte/client.cfg Feb 27 02:00:43 devstack quobyte-client[82760]: Invalid parameters found, error: missing mount point. Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.volume_clear_size = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack quobyte-client[82760]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 27 02:00:43 devstack quobyte-client[82760]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_reports.file_event_handler = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_reports.log_dir = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.backend_availability_zone = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.backend_host = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.chap_password = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.chap_username = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.chiscsi_conf = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.disk_geometry = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.driver_client_cert = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.driver_data_namespace = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.driver_use_ssl = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.extra_capabilities = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.filter_function = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.goodness_function = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.iser_helper = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.iser_ip_address = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.iser_port = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.iser_target_prefix = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.nas_host = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.nas_login = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.nas_mount_options = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.nas_password = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82759]: DEBUG oslo_concurrency.processutils [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=82759) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.nas_private_key = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82759]: DEBUG oslo_concurrency.lockutils [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82759) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82759]: DEBUG oslo_concurrency.lockutils [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82759) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.nas_share_path = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82759]: DEBUG cinder.volume.drivers.quobyte [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=82759) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.nas_ssh_port = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82759]: INFO cinder.volume.drivers.quobyte [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb ... Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.num_shell_tries = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82759]: DEBUG oslo_concurrency.processutils [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 -c /etc/quobyte/client-cinder.cfg {{(pid=82759) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.nvmet_port_id = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.replication_device = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.report_discard_supported = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.reserved_percentage = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.scst_target_driver = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.storage_protocol = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.target_helper = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.target_ip_address = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.target_port = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.target_prefix = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.target_protocol = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.trace_flags = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.use_chap_auth = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.volume_clear = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.volume_clear_size = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] QuobyteHD.volumes_dir = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.ssl = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_notifications.driver = [] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_notifications.retry = -1 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] key_manager.fixed_key = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican.barbican_api_version = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican.barbican_endpoint = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican.barbican_endpoint_type = public {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican.barbican_region_name = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican.cafile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican.certfile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican.collect_timing = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican.insecure = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican.keyfile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican.number_of_retries = 60 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican.retry_delay = 1 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican.send_service_user_token = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican.split_loggers = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican.timeout = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican.verify_ssl = True {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican.verify_ssl_path = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican_service_user.auth_section = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican_service_user.auth_type = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican_service_user.cafile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican_service_user.certfile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican_service_user.collect_timing = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican_service_user.insecure = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican_service_user.keyfile = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican_service_user.split_loggers = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] barbican_service_user.timeout = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] vault.approle_role_id = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] vault.approle_secret_id = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] vault.kv_mountpoint = secret {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] vault.kv_path = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] vault.kv_version = 2 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] vault.namespace = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] vault.root_token_id = **** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack sudo[82761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 -c /etc/quobyte/client-cinder.cfg Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] vault.ssl_ca_crt_file = None {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] vault.timeout = 60.0 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] vault.use_ssl = False {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:43 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] ******************************************************************************** {{(pid=82640) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 02:00:43 devstack sudo[82761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:44 devstack sudo[82761]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:44 devstack cinder-volume[82759]: DEBUG oslo_concurrency.processutils [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.531s {{(pid=82759) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:44 devstack cinder-volume[82759]: INFO cinder.volume.drivers.quobyte [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb succeeded Feb 27 02:00:44 devstack cinder-volume[82759]: DEBUG cinder.volume.drivers.quobyte [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=82759) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:44 devstack cinder-volume[82759]: DEBUG oslo_concurrency.lockutils [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.538s {{(pid=82759) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:44 devstack cinder-volume[82759]: DEBUG oslo_concurrency.processutils [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=82759) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:44 devstack sudo[82830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:00:44 devstack sudo[82830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:44 devstack sudo[82830]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:44 devstack cinder-volume[82759]: DEBUG oslo_concurrency.processutils [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.434s {{(pid=82759) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:44 devstack cinder-volume[82759]: INFO cinder.volume.driver [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Driver hasn't implemented _init_vendor_properties() Feb 27 02:00:44 devstack cinder-volume[82759]: DEBUG cinder.volume.driver [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82759) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 02:00:44 devstack cinder-volume[82759]: DEBUG oslo_db.sqlalchemy.engines [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82759) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:44 devstack cinder-volume[82759]: DEBUG dbcounter [-] [82759] Writer thread running {{(pid=82759) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 02:00:44 devstack cinder-volume[82759]: DEBUG cinder.db.sqlalchemy.api [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Building query based on filter {{(pid=82759) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 02:00:44 devstack cinder-volume[82759]: DEBUG cinder.image.image_utils [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82759) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 02:00:44 devstack cinder-volume[82759]: INFO cinder.keymgr.migration [None req-25bdc31d-3ffe-4a1e-8031-345a9d7fb29d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 02:00:44 devstack cinder-volume[82759]: DEBUG oslo_concurrency.lockutils [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82759) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:44 devstack cinder-volume[82759]: DEBUG oslo_concurrency.lockutils [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82759) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:44 devstack cinder-volume[82759]: DEBUG cinder.volume.drivers.quobyte [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=82759) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:44 devstack cinder-volume[82759]: DEBUG cinder.volume.drivers.quobyte [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=82759) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:44 devstack cinder-volume[82759]: DEBUG oslo_concurrency.lockutils [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82759) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:44 devstack cinder-volume[82759]: DEBUG oslo_concurrency.processutils [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=82759) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:44 devstack sudo[82838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:00:44 devstack sudo[82838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:45 devstack sudo[82838]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:45 devstack cinder-volume[82759]: DEBUG oslo_concurrency.processutils [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.414s {{(pid=82759) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:45 devstack cinder-volume[82759]: DEBUG cinder.manager [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Notifying Schedulers of capabilities ... {{(pid=82759) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:00:45 devstack cinder-volume[82759]: INFO cinder.volume.manager [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Driver initialization completed successfully. Feb 27 02:00:45 devstack cinder-volume[82759]: INFO cinder.manager [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Initiating service 3 cleanup Feb 27 02:00:45 devstack cinder-volume[82759]: INFO cinder.manager [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Service 3 cleanup completed. Feb 27 02:00:45 devstack cinder-volume[82759]: DEBUG cinder.service [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Creating RPC server for service cinder-volume {{(pid=82759) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 02:00:45 devstack cinder-volume[82759]: DEBUG cinder.service [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82759) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 02:00:45 devstack cinder-volume[82759]: INFO cinder.volume.manager [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 27 02:00:45 devstack cinder-volume[82759]: DEBUG oslo_concurrency.lockutils [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82759) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:45 devstack cinder-volume[82759]: DEBUG oslo_concurrency.lockutils [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82759) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:45 devstack cinder-volume[82759]: DEBUG cinder.volume.drivers.quobyte [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=82759) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:45 devstack cinder-volume[82759]: DEBUG cinder.volume.drivers.quobyte [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=82759) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:45 devstack cinder-volume[82759]: DEBUG oslo_concurrency.lockutils [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82759) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:45 devstack cinder-volume[82759]: DEBUG oslo_concurrency.processutils [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=82759) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:45 devstack sudo[82861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:00:45 devstack sudo[82861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:46 devstack sudo[82861]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:46 devstack cinder-volume[82759]: DEBUG oslo_concurrency.processutils [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.635s {{(pid=82759) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:46 devstack cinder-volume[82759]: INFO cinder.volume.manager [None req-7e6b63a5-aea3-4cff-b97c-19e0b9e9bfcf None None] Driver post RPC initialization completed successfully. Feb 27 02:00:47 devstack cinder-volume[82759]: DEBUG oslo_concurrency.lockutils [None req-593c1a48-83f6-48e2-a2a4-4a81a336a86f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82759) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:47 devstack cinder-volume[82759]: DEBUG oslo_concurrency.lockutils [None req-593c1a48-83f6-48e2-a2a4-4a81a336a86f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82759) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:47 devstack cinder-volume[82759]: DEBUG cinder.volume.drivers.quobyte [None req-593c1a48-83f6-48e2-a2a4-4a81a336a86f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=82759) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:47 devstack cinder-volume[82759]: DEBUG cinder.volume.drivers.quobyte [None req-593c1a48-83f6-48e2-a2a4-4a81a336a86f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=82759) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:47 devstack cinder-volume[82759]: DEBUG oslo_concurrency.lockutils [None req-593c1a48-83f6-48e2-a2a4-4a81a336a86f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82759) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:47 devstack cinder-volume[82759]: DEBUG oslo_concurrency.processutils [None req-593c1a48-83f6-48e2-a2a4-4a81a336a86f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=82759) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:47 devstack sudo[82904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:00:47 devstack sudo[82904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:48 devstack sudo[82904]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:48 devstack cinder-volume[82759]: DEBUG oslo_concurrency.processutils [None req-593c1a48-83f6-48e2-a2a4-4a81a336a86f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.430s {{(pid=82759) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:48 devstack cinder-volume[82759]: DEBUG cinder.manager [None req-593c1a48-83f6-48e2-a2a4-4a81a336a86f None None] Notifying Schedulers of capabilities ... {{(pid=82759) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:00:48 devstack cinder-volume[82640]: INFO oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Caught SIGTERM, stopping children Feb 27 02:00:48 devstack cinder-volume[82640]: DEBUG oslo_concurrency.lockutils [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Acquiring lock "singleton_lock" {{(pid=82640) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:00:48 devstack cinder-volume[82640]: DEBUG oslo_concurrency.lockutils [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Acquired lock "singleton_lock" {{(pid=82640) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:00:48 devstack cinder-volume[82640]: DEBUG oslo_concurrency.lockutils [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Releasing lock "singleton_lock" {{(pid=82640) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:00:48 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Stop services. {{(pid=82640) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 27 02:00:48 devstack cinder-volume[82640]: DEBUG oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Killing children. {{(pid=82640) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 27 02:00:48 devstack cinder-volume[82640]: INFO oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Waiting on 1 children to exit Feb 27 02:00:53 devstack cinder-volume[82759]: DEBUG oslo_concurrency.lockutils [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Acquiring lock "singleton_lock" {{(pid=82759) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:00:53 devstack cinder-volume[82759]: DEBUG oslo_concurrency.lockutils [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Acquired lock "singleton_lock" {{(pid=82759) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:00:53 devstack cinder-volume[82759]: DEBUG oslo_concurrency.lockutils [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Releasing lock "singleton_lock" {{(pid=82759) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:00:53 devstack cinder-volume[82759]: WARNING amqp [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 02:00:53 devstack cinder-volume[82759]: WARNING amqp [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 02:00:53 devstack cinder-volume[82640]: INFO oslo_service.backend._eventlet.service [None req-e475bfc3-fffc-4392-b1e9-cd6762532188 None None] Child 82759 exited with status 0 Feb 27 02:00:55 devstack cinder-volume[82988]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82988) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:00:55 devstack cinder-volume[82988]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82988) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:00:55 devstack cinder-volume[82988]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82988) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:00:56 devstack cinder-volume[82988]: INFO dbcounter [None req-b553967d-b626-48b4-86ca-24de85026634 None None] Registered counter for database cinder Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_db.sqlalchemy.engines [None req-b553967d-b626-48b4-86ca-24de85026634 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82988) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG dbcounter [-] [82988] Writer thread running {{(pid=82988) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 02:00:56 devstack cinder-volume[82988]: INFO cinder.rpc [None req-b553967d-b626-48b4-86ca-24de85026634 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 02:00:56 devstack cinder-volume[82988]: INFO cinder.rpc [None req-b553967d-b626-48b4-86ca-24de85026634 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_db.sqlalchemy.engines [None req-b553967d-b626-48b4-86ca-24de85026634 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82988) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:56 devstack cinder-volume[82988]: INFO cinder.volume.manager [None req-b553967d-b626-48b4-86ca-24de85026634 None None] Determined volume DB was empty at startup. Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG cinder.volume.manager [None req-b553967d-b626-48b4-86ca-24de85026634 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82988) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 02:00:56 devstack cinder-volume[82988]: WARNING stevedore.named [None req-b553967d-b626-48b4-86ca-24de85026634 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 02:00:56 devstack cinder-volume[82988]: WARNING castellan.key_manager [None req-b553967d-b626-48b4-86ca-24de85026634 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 02:00:56 devstack cinder-volume[82988]: WARNING cinder.keymgr.conf_key_mgr [None req-b553967d-b626-48b4-86ca-24de85026634 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 02:00:56 devstack cinder-volume[82988]: INFO cinder.volume.manager [None req-b553967d-b626-48b4-86ca-24de85026634 None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_db.sqlalchemy.engines [None req-b553967d-b626-48b4-86ca-24de85026634 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82988) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:56 devstack cinder-volume[82988]: INFO oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] Starting 1 workers Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] Started child 83167 {{(pid=82988) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] Full set of CONF: {{(pid=82988) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] ******************************************************************************** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] Configuration options gathered from: {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 02:00:56 devstack cinder-volume[83167]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] ================================================================================ {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] allow_availability_zone_fallback = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] allow_compression_on_image_upload = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] allowed_direct_url_schemes = [] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] api_rate_limit = True {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] auth_strategy = keystone {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_availability_zone = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_host = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_name = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_stats_polling_interval = 60 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backup_api_class = cinder.backup.api.API {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backup_name_template = backup-%s {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backup_use_same_host = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backup_use_temp_snapshot = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] chap_password = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] chap_username = {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cinder_internal_tenant_project_id = e6b647c3a074494cb424422a9d74cb28 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cinder_internal_tenant_user_id = f21ebf34b9d04ea088ea94aec6cac3c0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cluster = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] compression_format = gzip {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] compute_api_class = cinder.compute.nova.API {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] config_dir = [] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] config_source = [] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] control_exchange = openstack {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] debug = True {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] default_availability_zone = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] default_group_type = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] default_volume_type = QuobyteHD {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] disk_geometry = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] driver_client_cert = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] driver_client_cert_key = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] driver_data_namespace = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] driver_ssl_cert_path = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] driver_ssl_cert_verify = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] driver_use_ssl = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] enable_new_services = True {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] enable_unsupported_driver = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] enabled_backends = ['QuobyteHD'] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] enforce_multipath_for_image_xfer = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] filter_function = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] glance_api_insecure = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] glance_api_servers = ['http://192.168.122.156/image'] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] glance_api_ssl_compression = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] glance_ca_certificates_file = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] glance_catalog_info = image:glance:publicURL {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] glance_certfile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] glance_keyfile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] glance_num_retries = 3 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] glance_request_timeout = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] goodness_function = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] graceful_shutdown_timeout = 5 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] group_api_class = cinder.group.api.API {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] host = devstack {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] image_compress_on_upload = True {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] image_conversion_address_space_limit = 1 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] image_conversion_cpu_limit = 60 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] image_conversion_disable = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] image_upload_use_cinder_backend = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] image_upload_use_internal_tenant = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] image_volume_cache_enabled = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] image_volume_cache_max_count = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] image_volume_cache_max_size_gb = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] init_host_max_objects_retrieval = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] instance_format = [instance: %(uuid)s] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] iscsi_target_flags = {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] iscsi_write_cache = on {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] iser_helper = tgtadm {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] iser_ip_address = 192.168.122.156 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] iser_port = 3260 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] log_color = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] log_config_append = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] log_dir = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] log_file = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] log_options = True {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] log_rotate_interval = 1 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] log_rotate_interval_type = days {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] log_rotation_type = none {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Starting volume driver QuobyteDriver (1.1.14) Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83167) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] max_age = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] max_logfile_count = 30 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] max_logfile_size_mb = 200 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] max_over_subscription_ratio = 20.0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] message_reap_interval = 86400 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] message_ttl = 2592000 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] migration_create_volume_timeout_secs = 300 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] monkey_patch = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] monkey_patch_modules = [] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] my_ip = 192.168.122.156 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] no_snapshot_gb_quota = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] num_iser_scan_tries = 3 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] num_shell_tries = 3 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] num_volume_device_scan_tries = 3 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] nvmeof_conn_info_version = 1 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] nvmet_ns_id = 10 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] nvmet_port_id = 1 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] osapi_max_limit = 1000 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] osapi_volume_ext_list = [] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] osapi_volume_listen_port = 8776 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] osapi_volume_use_ssl = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] osapi_volume_workers = 2 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] per_volume_size_limit = -1 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] periodic_fuzzy_delay = 60 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] periodic_interval = 60 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] public_endpoint = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] publish_errors = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] quota_backup_gigabytes = 1000 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] quota_backups = 10 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] quota_gigabytes = 1000 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] quota_groups = 10 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] quota_snapshots = 10 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] quota_volumes = 10 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] rate_limit_burst = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] rate_limit_except_level = CRITICAL {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] rate_limit_interval = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] reinit_driver_count = 3 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] replication_device = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] report_discard_supported = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] report_interval = 120 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] reservation_clean_interval = 86400 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] reservation_expire = 86400 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] reserved_image_namespaces = [] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] reserved_percentage = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] rpc_response_timeout = 120 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] run_external_periodic_tasks = True {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] scst_target_driver = iscsi {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] scst_target_iqn_name = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] service_down_time = 720 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] shell_completion = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] snapshot_name_template = snapshot-%s {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] split_loggers = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] state_path = /opt/stack/data/cinder {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] storage_availability_zone = nova {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] storage_protocol = iSCSI {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] syslog_log_facility = LOG_USER {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] target_helper = lioadm {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] target_ip_address = 192.168.122.156 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] target_port = 3260 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] target_protocol = iscsi {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] target_secondary_ip_addresses = [] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] trace_flags = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] transport_url = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] until_refresh = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] use_chap_auth = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] use_default_quota_class = True {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] use_journal = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] use_json = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] use_multipath_for_image_xfer = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] use_stderr = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] use_syslog = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] verify_glance_signatures = enabled {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] volume_api_class = cinder.volume.api.API {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] volume_backend_name = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] volume_clear = zero {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] volume_clear_ionice = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] volume_clear_size = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] volume_copy_bps_limit = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] volume_dd_blocksize = 1M {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] volume_name_template = volume-%s {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] volume_service_inithost_offload = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] volume_usage_audit_period = month {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] zoning_mode = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_concurrency.disable_process_locking = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.admin_password = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.admin_token = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.admin_user = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.auth_port = 35357 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.auth_protocol = https {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.auth_section = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.auth_type = password {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.auth_uri = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.auth_version = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.cache = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.certfile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83167) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 27 02:00:56 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.quobyte [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 27 02:00:56 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.quobyte [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.identity_uri = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Running cmd (subprocess): mount.quobyte {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.include_service_catalog = True {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.insecure = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.interface = public {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.keyfile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.memcache_password = {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.memcache_username = {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.region_name = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.service_type = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.156/identity {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.backend = dogpile.cache.null {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.backend_argument = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.backend_expiration_time = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.config_prefix = cache.oslo {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.debug_cache_backend = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.enable_retry_client = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.enable_socket_keepalive = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.enabled = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.enforce_fips_mode = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.expiration_time = 600 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.hashclient_retry_attempts = 2 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.memcache_dead_retry = 300 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.memcache_pool_maxsize = 10 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.memcache_sasl_enabled = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.password = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.proxies = [] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.redis_db = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.redis_server = localhost:6379 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.retry_attempts = 2 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.retry_delay = 0.0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.socket_keepalive_count = 1 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.socket_keepalive_idle = 1 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.socket_keepalive_interval = 1 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.socket_timeout = 1.0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.tls_allowed_ciphers = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.tls_cafile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.tls_certfile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.tls_enabled = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.tls_keyfile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cache.username = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] coordination.backend_url = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.asyncio_connection = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.asyncio_slave_connection = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.backend = sqlalchemy {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.connection = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.connection_debug = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.connection_parameters = {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.connection_recycle_time = 3600 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.connection_trace = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.db_inc_retry_interval = True {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.db_max_retries = 20 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.db_max_retry_interval = 10 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.db_retry_interval = 1 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.max_overflow = 50 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.max_pool_size = 5 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.max_retries = 10 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.mysql_wsrep_sync_wait = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.pool_timeout = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.retry_interval = 10 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.slave_connection = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.sqlite_synchronous = True {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.synchronous_reader = True {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] database.use_db_reconnect = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] profiler.connection_string = messaging:// {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] profiler.enabled = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] profiler.es_doc_type = notification {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] profiler.es_scroll_size = 10000 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] profiler.es_scroll_time = 2m {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] profiler.filter_error_trace = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] profiler.hmac_keys = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] profiler.sentinel_service_name = mymaster {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] profiler.socket_timeout = 0.1 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] profiler.trace_requests = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] profiler.trace_sqlalchemy = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] profiler_jaeger.process_tags = {} {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] profiler_jaeger.service_name_prefix = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] profiler_otlp.service_name_prefix = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_policy.enforce_new_defaults = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: WARNING oslo_config.cfg [None req-b553967d-b626-48b4-86ca-24de85026634 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_policy.enforce_scope = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_policy.policy_default_rule = default {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_policy.policy_file = policy.yaml {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] privsep_osbrick.group = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] privsep_osbrick.helper_command = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] privsep_osbrick.user = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cinder_sys_admin.group = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cinder_sys_admin.helper_command = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] cinder_sys_admin.user = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] service_user.auth_section = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] service_user.auth_type = password {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] service_user.cafile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] service_user.certfile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] service_user.collect_timing = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] service_user.insecure = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] service_user.keyfile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] service_user.send_service_user_token = True {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack quobyte-client[83174]: Reading configuration file: /etc/quobyte/client.cfg Feb 27 02:00:56 devstack quobyte-client[83174]: Invalid parameters found, error: missing mount point. Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] service_user.split_loggers = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack quobyte-client[83174]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 27 02:00:56 devstack quobyte-client[83174]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] service_user.timeout = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] glance.auth_section = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] glance.auth_type = password {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] glance.certfile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] glance.collect_timing = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] CMD "mount.quobyte" returned: 1 in 0.051s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] glance.insecure = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] glance.keyfile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] glance.region_name = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] glance.split_loggers = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] glance.timeout = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.backend_availability_zone = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.chap_password = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.chap_username = {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.disk_geometry = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.driver_client_cert = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.driver_client_cert_key = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.driver_data_namespace = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.driver_use_ssl = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.extra_capabilities = {} {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.filter_function = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.goodness_function = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.iscsi_target_flags = {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.iscsi_write_cache = on {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.iser_helper = tgtadm {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.iser_ip_address = 192.168.122.156 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.iser_port = 3260 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.nas_host = {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.nas_login = admin {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.nas_mount_options = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.nas_password = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.nas_private_key = {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.nas_share_path = {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.num_shell_tries = 3 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack sudo[83175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.quobyte_volume_url = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack sudo[83175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.replication_device = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.report_discard_supported = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.reserved_percentage = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.target_helper = tgtadm {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.target_ip_address = 192.168.122.156 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.target_port = 3260 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.target_protocol = iscsi {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.trace_flags = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.unique_fqdn_network = True {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.use_chap_auth = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.volume_backend_name = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.volume_clear = zero {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.volume_clear_ionice = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.volume_clear_size = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_reports.file_event_handler = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_reports.log_dir = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.backend_availability_zone = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.backend_host = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.chap_password = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.chap_username = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.chiscsi_conf = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.disk_geometry = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.driver_client_cert = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.driver_data_namespace = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.driver_use_ssl = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.extra_capabilities = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.filter_function = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.goodness_function = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.iser_helper = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.iser_ip_address = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.iser_port = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.iser_target_prefix = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.nas_host = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.nas_login = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.nas_mount_options = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.nas_password = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.nas_private_key = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.nas_share_path = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.nas_ssh_port = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.num_shell_tries = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.nvmet_port_id = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.replication_device = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.report_discard_supported = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.reserved_percentage = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.scst_target_driver = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.storage_protocol = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.target_helper = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.target_ip_address = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.target_port = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.target_prefix = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.target_protocol = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.trace_flags = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.use_chap_auth = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.volume_clear = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.volume_clear_size = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] QuobyteHD.volumes_dir = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.ssl = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_notifications.driver = [] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_notifications.retry = -1 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] key_manager.fixed_key = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican.barbican_api_version = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican.barbican_endpoint = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican.barbican_endpoint_type = public {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican.barbican_region_name = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican.cafile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican.certfile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican.collect_timing = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican.insecure = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican.keyfile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican.number_of_retries = 60 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican.retry_delay = 1 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican.send_service_user_token = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican.split_loggers = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican.timeout = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican.verify_ssl = True {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican.verify_ssl_path = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican_service_user.auth_section = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican_service_user.auth_type = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican_service_user.cafile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican_service_user.certfile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican_service_user.collect_timing = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican_service_user.insecure = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican_service_user.keyfile = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican_service_user.split_loggers = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] barbican_service_user.timeout = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] vault.approle_role_id = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] vault.approle_secret_id = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] vault.kv_mountpoint = secret {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] vault.kv_path = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] vault.kv_version = 2 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] vault.namespace = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] vault.root_token_id = **** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] vault.ssl_ca_crt_file = None {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] vault.timeout = 60.0 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] vault.use_ssl = False {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:56 devstack cinder-volume[82988]: DEBUG oslo_service.backend._eventlet.service [None req-b553967d-b626-48b4-86ca-24de85026634 None None] ******************************************************************************** {{(pid=82988) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 02:00:56 devstack sudo[83175]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.433s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:56 devstack cinder-volume[83167]: INFO cinder.volume.driver [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Driver hasn't implemented _init_vendor_properties() Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG cinder.volume.driver [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83167) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG oslo_db.sqlalchemy.engines [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83167) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writer thread running {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG cinder.db.sqlalchemy.api [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Building query based on filter {{(pid=83167) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83167) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:56 devstack cinder-volume[83167]: INFO cinder.keymgr.migration [None req-818c7cb6-6c6c-4f0c-bb08-60610633eb1c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 02:00:56 devstack sudo[83214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:00:56 devstack sudo[83214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:57 devstack sudo[83214]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.430s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:57 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:00:57 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Driver initialization completed successfully. Feb 27 02:00:57 devstack cinder-volume[83167]: INFO cinder.manager [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Initiating service 3 cleanup Feb 27 02:00:57 devstack cinder-volume[83167]: INFO cinder.manager [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Service 3 cleanup completed. Feb 27 02:00:57 devstack cinder-volume[83167]: DEBUG cinder.service [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Creating RPC server for service cinder-volume {{(pid=83167) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 02:00:57 devstack cinder-volume[83167]: DEBUG cinder.service [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83167) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 02:00:57 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 27 02:00:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:57 devstack sudo[83229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:00:57 devstack sudo[83229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:57 devstack sudo[83229]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.429s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:57 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-94a6e6d8-dc9b-4d5b-87c3-a27ef1f78b81 None None] Driver post RPC initialization completed successfully. Feb 27 02:01:06 devstack cinder-volume[82988]: DEBUG dbcounter [-] [82988] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82988) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:01:07 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=2 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:01:07 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Flow 'volume_create_manager' (9213d437-0caa-415e-8a1d-1e9c827d1b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832e48b7-e2ae-4a18-a516-b1e302f3d8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832e48b7-e2ae-4a18-a516-b1e302f3d8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-598218610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffadcc11-f26d-49d0-9042-f02beec8ceea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d0632b307075498d957f05056ba8e0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:54Z,use_quota=True,user_id='dd2b93188368404eb1e299ccfe950ca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5682441-d720-4a43-9452-d78c9bf681ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5682441-d720-4a43-9452-d78c9bf681ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deabe34b-9708-4ea8-9e0c-df176053c4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deabe34b-9708-4ea8-9e0c-df176053c4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffadcc11-f26d-49d0-9042-f02beec8ceea', 'volume_name': 'volume-ffadcc11-f26d-49d0-9042-f02beec8ceea', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85bbf958-267c-4eef-98ca-478f5de31317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85bbf958-267c-4eef-98ca-478f5de31317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21ff91b-a2c8-4819-bddf-76c5199b5895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:54 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Volume ffadcc11-f26d-49d0-9042-f02beec8ceea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffadcc11-f26d-49d0-9042-f02beec8ceea', 'volume_size': 1} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-598218610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffadcc11-f26d-49d0-9042-f02beec8ceea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d0632b307075498d957f05056ba8e0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:54Z,use_quota=True,user_id='dd2b93188368404eb1e299ccfe950ca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Creating volume ffadcc11-f26d-49d0-9042-f02beec8ceea {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:01:54 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:01:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ffadcc11-f26d-49d0-9042-f02beec8ceea 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:54 devstack sudo[83574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ffadcc11-f26d-49d0-9042-f02beec8ceea 1073741824 Feb 27 02:01:54 devstack sudo[83574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:55 devstack sudo[83574]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ffadcc11-f26d-49d0-9042-f02beec8ceea 1073741824" returned: 0 in 0.753s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ffadcc11-f26d-49d0-9042-f02beec8ceea {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:55 devstack sudo[83899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ffadcc11-f26d-49d0-9042-f02beec8ceea Feb 27 02:01:55 devstack sudo[83899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:55 devstack sudo[83899]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ffadcc11-f26d-49d0-9042-f02beec8ceea" returned: 0 in 0.551s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:01:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21ff91b-a2c8-4819-bddf-76c5199b5895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffadcc11-f26d-49d0-9042-f02beec8ceea', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b53cd0-222d-40e8-9466-29993cbfb567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:55 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Volume volume-ffadcc11-f26d-49d0-9042-f02beec8ceea (ffadcc11-f26d-49d0-9042-f02beec8ceea): created successfully Feb 27 02:01:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b53cd0-222d-40e8-9466-29993cbfb567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Flow 'volume_create_manager' (9213d437-0caa-415e-8a1d-1e9c827d1b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:01:55 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-88b0e853-959d-4933-a494-be3615cad395 tempest-VolumesTestJSON-477488939 None] Created volume successfully. Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Flow 'volume_create_manager' (d83d9dac-d5a3-448c-b577-f2e7864e351d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e719c9a4-9ae9-4bf6-929a-7f187dd584f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e719c9a4-9ae9-4bf6-929a-7f187dd584f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-112505818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2fc70a8-2e40-4d20-924d-944799f88206,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d0632b307075498d957f05056ba8e0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:57Z,use_quota=True,user_id='dd2b93188368404eb1e299ccfe950ca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c7ca9b-8d60-4bdc-bd72-b8737e5bcf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c7ca9b-8d60-4bdc-bd72-b8737e5bcf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae2b1af-3b11-41ad-b004-91d3acc35c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae2b1af-3b11-41ad-b004-91d3acc35c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2fc70a8-2e40-4d20-924d-944799f88206', 'volume_name': 'volume-a2fc70a8-2e40-4d20-924d-944799f88206', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92052206-3933-45e3-959a-2eee7ff9aa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92052206-3933-45e3-959a-2eee7ff9aa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ffb40a0-e0e5-4a11-b1a7-0b8a5aaa6fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:56 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Volume a2fc70a8-2e40-4d20-924d-944799f88206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2fc70a8-2e40-4d20-924d-944799f88206', 'volume_size': 1} Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-112505818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2fc70a8-2e40-4d20-924d-944799f88206,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d0632b307075498d957f05056ba8e0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:57Z,use_quota=True,user_id='dd2b93188368404eb1e299ccfe950ca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Creating volume a2fc70a8-2e40-4d20-924d-944799f88206 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:01:56 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:01:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a2fc70a8-2e40-4d20-924d-944799f88206 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:56 devstack sudo[83905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a2fc70a8-2e40-4d20-924d-944799f88206 1073741824 Feb 27 02:01:56 devstack sudo[83905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:57 devstack sudo[83905]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a2fc70a8-2e40-4d20-924d-944799f88206 1073741824" returned: 0 in 0.840s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a2fc70a8-2e40-4d20-924d-944799f88206 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:57 devstack sudo[83913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a2fc70a8-2e40-4d20-924d-944799f88206 Feb 27 02:01:57 devstack sudo[83913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:58 devstack sudo[83913]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a2fc70a8-2e40-4d20-924d-944799f88206" returned: 0 in 0.586s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:01:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ffb40a0-e0e5-4a11-b1a7-0b8a5aaa6fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2fc70a8-2e40-4d20-924d-944799f88206', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db8dd54-0bc2-429c-b17f-590966589d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:58 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Volume volume-a2fc70a8-2e40-4d20-924d-944799f88206 (a2fc70a8-2e40-4d20-924d-944799f88206): created successfully Feb 27 02:01:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db8dd54-0bc2-429c-b17f-590966589d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Flow 'volume_create_manager' (d83d9dac-d5a3-448c-b577-f2e7864e351d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:01:58 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e63740a5-6d60-41e6-91f0-8b2616825624 tempest-VolumesTestJSON-477488939 None] Created volume successfully. Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Flow 'volume_create_manager' (3053a5e7-d549-4684-af43-19b1f5a620d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (075948c4-ed64-474c-8dd5-301a8f7429ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (075948c4-ed64-474c-8dd5-301a8f7429ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1664618973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf3092b-b2b7-49a7-8d01-3cb34b885bc2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d0632b307075498d957f05056ba8e0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:00Z,use_quota=True,user_id='dd2b93188368404eb1e299ccfe950ca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2834ee39-f1ee-4ad6-b4a6-290ad2264b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2834ee39-f1ee-4ad6-b4a6-290ad2264b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e4307d-1211-47e9-b2d6-11e4c2b18f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e4307d-1211-47e9-b2d6-11e4c2b18f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abf3092b-b2b7-49a7-8d01-3cb34b885bc2', 'volume_name': 'volume-abf3092b-b2b7-49a7-8d01-3cb34b885bc2', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ba6889-7d47-4930-9ace-5031195ca475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ba6889-7d47-4930-9ace-5031195ca475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c36aab-67a2-4e06-84c2-0159e8c50066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:59 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Volume abf3092b-b2b7-49a7-8d01-3cb34b885bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abf3092b-b2b7-49a7-8d01-3cb34b885bc2', 'volume_size': 1} Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1664618973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf3092b-b2b7-49a7-8d01-3cb34b885bc2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d0632b307075498d957f05056ba8e0e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:00Z,use_quota=True,user_id='dd2b93188368404eb1e299ccfe950ca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Creating volume abf3092b-b2b7-49a7-8d01-3cb34b885bc2 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:01:59 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:01:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-abf3092b-b2b7-49a7-8d01-3cb34b885bc2 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:59 devstack sudo[83921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-abf3092b-b2b7-49a7-8d01-3cb34b885bc2 1073741824 Feb 27 02:01:59 devstack sudo[83921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:02 devstack sudo[83921]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-abf3092b-b2b7-49a7-8d01-3cb34b885bc2 1073741824" returned: 0 in 2.304s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-abf3092b-b2b7-49a7-8d01-3cb34b885bc2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:02 devstack sudo[83926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-abf3092b-b2b7-49a7-8d01-3cb34b885bc2 Feb 27 02:02:02 devstack sudo[83926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:04 devstack sudo[83926]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-abf3092b-b2b7-49a7-8d01-3cb34b885bc2" returned: 0 in 1.738s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] <== create_volume: return (4150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.153s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c36aab-67a2-4e06-84c2-0159e8c50066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf3092b-b2b7-49a7-8d01-3cb34b885bc2', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23a4209-8d37-4266-b420-11791dd87397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:04 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Volume volume-abf3092b-b2b7-49a7-8d01-3cb34b885bc2 (abf3092b-b2b7-49a7-8d01-3cb34b885bc2): created successfully Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23a4209-8d37-4266-b420-11791dd87397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Flow 'volume_create_manager' (3053a5e7-d549-4684-af43-19b1f5a620d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:04 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-16e69d52-e443-4fa3-8902-3649970d8eaa tempest-VolumesTestJSON-477488939 None] Created volume successfully. Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Flow 'volume_create_manager' (f824188c-4664-4604-b8e3-d88f336c93af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d264460e-1671-480d-ba28-67404073c235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d264460e-1671-480d-ba28-67404073c235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1640945890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a50cbd8-c451-4dfd-a972-1afa1dc99b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ee2dc8c7e6948b6af34e6045987b568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:04Z,use_quota=True,user_id='b403af4d844d4143bd047c2d73ea18a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ad6043-cba3-4ea9-94ad-bce5385edf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ad6043-cba3-4ea9-94ad-bce5385edf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbe9a13-37fc-4342-8289-be5d9b956e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbe9a13-37fc-4342-8289-be5d9b956e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a50cbd8-c451-4dfd-a972-1afa1dc99b1c', 'volume_name': 'volume-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fe9c8c-d545-4cad-843c-a17ca68ca85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fe9c8c-d545-4cad-843c-a17ca68ca85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9ace0b-973a-438d-b290-804072824215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:04 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Volume 5a50cbd8-c451-4dfd-a972-1afa1dc99b1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c', 'volume_size': 1} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1640945890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a50cbd8-c451-4dfd-a972-1afa1dc99b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ee2dc8c7e6948b6af34e6045987b568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:04Z,use_quota=True,user_id='b403af4d844d4143bd047c2d73ea18a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Creating volume 5a50cbd8-c451-4dfd-a972-1afa1dc99b1c {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:02:04 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:02:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:04 devstack sudo[83930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c 1073741824 Feb 27 02:02:04 devstack sudo[83930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Acquiring lock "cinder-abf3092b-b2b7-49a7-8d01-3cb34b885bc2-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Lock "cinder-abf3092b-b2b7-49a7-8d01-3cb34b885bc2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Acquiring lock "cinder-quobyte-abf3092b-b2b7-49a7-8d01-3cb34b885bc2" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Lock "cinder-quobyte-abf3092b-b2b7-49a7-8d01-3cb34b885bc2" acquired by "delete_volume" :: waited 0.018s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:06 devstack cinder-volume[83167]: INFO oslo.privsep.daemon [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpu8oova99/privsep.sock'] Feb 27 02:02:06 devstack sudo[83935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpu8oova99/privsep.sock Feb 27 02:02:06 devstack sudo[83935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:06 devstack sudo[83930]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c 1073741824" returned: 0 in 2.036s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:06 devstack sudo[83937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c Feb 27 02:02:06 devstack sudo[83937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:08 devstack sudo[83937]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c" returned: 0 in 1.601s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] <== create_volume: return (3689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:02:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.700s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9ace0b-973a-438d-b290-804072824215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70babf89-dbdf-4c27-b971-9c97ccfc9a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:08 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Volume volume-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c (5a50cbd8-c451-4dfd-a972-1afa1dc99b1c): created successfully Feb 27 02:02:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70babf89-dbdf-4c27-b971-9c97ccfc9a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Flow 'volume_create_manager' (f824188c-4664-4604-b8e3-d88f336c93af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:08 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-415cb3e5-f0aa-4784-b046-73737a02fcbd tempest-VolumesAdminNegativeTest-2071992145 None] Created volume successfully. Feb 27 02:02:09 devstack sudo[83935]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:09 devstack cinder-volume[83167]: INFO oslo.privsep.daemon [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Spawned new privsep daemon via rootwrap Feb 27 02:02:09 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Accepted privsep connection to /tmp/tmpu8oova99/privsep.sock {{(pid=83167) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Feb 27 02:02:09 devstack cinder-volume[83167]: INFO oslo.privsep.daemon [-] privsep daemon starting Feb 27 02:02:09 devstack cinder-volume[83167]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Feb 27 02:02:09 devstack cinder-volume[83167]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Feb 27 02:02:09 devstack cinder-volume[83167]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83969 Feb 27 02:02:09 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca29895-5a07-4549-ad38-6f0de9389ce0]: (2,) {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:09 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04aa7b2-53cb-4c24-9658-e03b7bd07e2e]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-abf3092b-b2b7-49a7-8d01-3cb34b885bc2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8e1520f7-e263-4ade-9e33-a1c02ef25957 tempest-VolumesAdminNegativeTest-2071992145 None] Acquiring lock "cinder-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:09 devstack sudo[83971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-abf3092b-b2b7-49a7-8d01-3cb34b885bc2 Feb 27 02:02:09 devstack sudo[83971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8e1520f7-e263-4ade-9e33-a1c02ef25957 tempest-VolumesAdminNegativeTest-2071992145 None] Lock "cinder-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8e1520f7-e263-4ade-9e33-a1c02ef25957 tempest-VolumesAdminNegativeTest-2071992145 None] Acquiring lock "cinder-quobyte-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8e1520f7-e263-4ade-9e33-a1c02ef25957 tempest-VolumesAdminNegativeTest-2071992145 None] Lock "cinder-quobyte-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c" acquired by "delete_volume" :: waited 0.023s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:09 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f62bcc-559e-44da-8cae-7f0d064c7ce0]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8e1520f7-e263-4ade-9e33-a1c02ef25957 tempest-VolumesAdminNegativeTest-2071992145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:09 devstack sudo[83973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c Feb 27 02:02:09 devstack sudo[83973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:10 devstack sudo[83971]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-abf3092b-b2b7-49a7-8d01-3cb34b885bc2" returned: 0 in 1.066s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-abf3092b-b2b7-49a7-8d01-3cb34b885bc2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:10 devstack sudo[83978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-abf3092b-b2b7-49a7-8d01-3cb34b885bc2 Feb 27 02:02:10 devstack sudo[83978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:10 devstack sudo[83973]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8e1520f7-e263-4ade-9e33-a1c02ef25957 tempest-VolumesAdminNegativeTest-2071992145 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c" returned: 0 in 0.934s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8e1520f7-e263-4ade-9e33-a1c02ef25957 tempest-VolumesAdminNegativeTest-2071992145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:10 devstack sudo[83984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c Feb 27 02:02:10 devstack sudo[83984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:10 devstack sudo[83978]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-abf3092b-b2b7-49a7-8d01-3cb34b885bc2" returned: 0 in 0.668s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Lock "cinder-quobyte-abf3092b-b2b7-49a7-8d01-3cb34b885bc2" released by "delete_volume" :: held 4.855s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:10 devstack cinder-volume[83167]: WARNING cinder.quota [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:02:10 devstack cinder-volume[83167]: WARNING cinder.quota [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:02:11 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Created reservations ['6efa2822-aa8a-4525-8b80-1278d3930e9b', '6d4413a1-6ecd-4e08-bb26-daaf176c2b13', '681c7111-cd26-449f-9617-2a59c3dfe11b', '6467b4eb-c748-4aea-ae7a-b1c204b853a2'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:11 devstack sudo[83989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:02:11 devstack sudo[83989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:11 devstack sudo[83984]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8e1520f7-e263-4ade-9e33-a1c02ef25957 tempest-VolumesAdminNegativeTest-2071992145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c" returned: 0 in 0.855s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8e1520f7-e263-4ade-9e33-a1c02ef25957 tempest-VolumesAdminNegativeTest-2071992145 None] Lock "cinder-quobyte-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c" released by "delete_volume" :: held 1.887s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:11 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-8e1520f7-e263-4ade-9e33-a1c02ef25957 tempest-VolumesAdminNegativeTest-2071992145 None] Created reservations ['e09fbf7f-cf73-447a-9adc-da2e60abf8d0', 'aeacd4d0-b3dd-4299-8f30-85fc033ad91c', '95bc8306-461d-4779-b1ed-b3fbef630724', '7a7fb78e-5667-43ff-86ee-70181006db96'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8e1520f7-e263-4ade-9e33-a1c02ef25957 tempest-VolumesAdminNegativeTest-2071992145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8e1520f7-e263-4ade-9e33-a1c02ef25957 tempest-VolumesAdminNegativeTest-2071992145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8e1520f7-e263-4ade-9e33-a1c02ef25957 tempest-VolumesAdminNegativeTest-2071992145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8e1520f7-e263-4ade-9e33-a1c02ef25957 tempest-VolumesAdminNegativeTest-2071992145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8e1520f7-e263-4ade-9e33-a1c02ef25957 tempest-VolumesAdminNegativeTest-2071992145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8e1520f7-e263-4ade-9e33-a1c02ef25957 tempest-VolumesAdminNegativeTest-2071992145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:11 devstack sudo[83992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:02:11 devstack sudo[83992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb6d72b8-a483-4bfa-95ad-a5d9578b1eed tempest-VolumesTestJSON-477488939 None] Acquiring lock "cinder-a2fc70a8-2e40-4d20-924d-944799f88206-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb6d72b8-a483-4bfa-95ad-a5d9578b1eed tempest-VolumesTestJSON-477488939 None] Lock "cinder-a2fc70a8-2e40-4d20-924d-944799f88206-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb6d72b8-a483-4bfa-95ad-a5d9578b1eed tempest-VolumesTestJSON-477488939 None] Acquiring lock "cinder-quobyte-a2fc70a8-2e40-4d20-924d-944799f88206" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb6d72b8-a483-4bfa-95ad-a5d9578b1eed tempest-VolumesTestJSON-477488939 None] Lock "cinder-quobyte-a2fc70a8-2e40-4d20-924d-944799f88206" acquired by "delete_volume" :: waited 0.021s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:12 devstack sudo[83989]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.938s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:12 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:12 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Deleted volume successfully. Feb 27 02:02:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5579414f-0b5a-4b09-930d-0f156571dcb1 tempest-VolumesTestJSON-477488939 None] Lock "cinder-abf3092b-b2b7-49a7-8d01-3cb34b885bc2-delete_volume" released by "delete_volume" :: held 6.054s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:12 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c32726f-f0ee-4ba1-85b4-c51a79f56c09]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb6d72b8-a483-4bfa-95ad-a5d9578b1eed tempest-VolumesTestJSON-477488939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a2fc70a8-2e40-4d20-924d-944799f88206 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:12 devstack sudo[83995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a2fc70a8-2e40-4d20-924d-944799f88206 Feb 27 02:02:12 devstack sudo[83995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:12 devstack sudo[83992]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8e1520f7-e263-4ade-9e33-a1c02ef25957 tempest-VolumesAdminNegativeTest-2071992145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 1.265s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:12 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-8e1520f7-e263-4ade-9e33-a1c02ef25957 tempest-VolumesAdminNegativeTest-2071992145 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:12 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8e1520f7-e263-4ade-9e33-a1c02ef25957 tempest-VolumesAdminNegativeTest-2071992145 None] Deleted volume successfully. Feb 27 02:02:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8e1520f7-e263-4ade-9e33-a1c02ef25957 tempest-VolumesAdminNegativeTest-2071992145 None] Lock "cinder-5a50cbd8-c451-4dfd-a972-1afa1dc99b1c-delete_volume" released by "delete_volume" :: held 3.454s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:13 devstack sudo[83995]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb6d72b8-a483-4bfa-95ad-a5d9578b1eed tempest-VolumesTestJSON-477488939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a2fc70a8-2e40-4d20-924d-944799f88206" returned: 0 in 1.318s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb6d72b8-a483-4bfa-95ad-a5d9578b1eed tempest-VolumesTestJSON-477488939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a2fc70a8-2e40-4d20-924d-944799f88206 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:13 devstack sudo[84033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a2fc70a8-2e40-4d20-924d-944799f88206 Feb 27 02:02:13 devstack sudo[84033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:14 devstack sudo[84033]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb6d72b8-a483-4bfa-95ad-a5d9578b1eed tempest-VolumesTestJSON-477488939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a2fc70a8-2e40-4d20-924d-944799f88206" returned: 0 in 0.991s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb6d72b8-a483-4bfa-95ad-a5d9578b1eed tempest-VolumesTestJSON-477488939 None] Lock "cinder-quobyte-a2fc70a8-2e40-4d20-924d-944799f88206" released by "delete_volume" :: held 2.438s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:14 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-cb6d72b8-a483-4bfa-95ad-a5d9578b1eed tempest-VolumesTestJSON-477488939 None] Created reservations ['5a672bc7-aceb-4991-97da-67ab0381fe11', 'c8f566ca-248b-4d16-b7ec-d0ea1aa55f58', '8e33c87e-1604-4b58-a705-35cc26df5c7c', 'e3c55dc3-9f2a-4ce0-977e-63f999f9ac94'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cb6d72b8-a483-4bfa-95ad-a5d9578b1eed tempest-VolumesTestJSON-477488939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cb6d72b8-a483-4bfa-95ad-a5d9578b1eed tempest-VolumesTestJSON-477488939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cb6d72b8-a483-4bfa-95ad-a5d9578b1eed tempest-VolumesTestJSON-477488939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cb6d72b8-a483-4bfa-95ad-a5d9578b1eed tempest-VolumesTestJSON-477488939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cb6d72b8-a483-4bfa-95ad-a5d9578b1eed tempest-VolumesTestJSON-477488939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb6d72b8-a483-4bfa-95ad-a5d9578b1eed tempest-VolumesTestJSON-477488939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:14 devstack sudo[84057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:02:14 devstack sudo[84057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:15 devstack sudo[84057]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb6d72b8-a483-4bfa-95ad-a5d9578b1eed tempest-VolumesTestJSON-477488939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.519s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-cb6d72b8-a483-4bfa-95ad-a5d9578b1eed tempest-VolumesTestJSON-477488939 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:15 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-cb6d72b8-a483-4bfa-95ad-a5d9578b1eed tempest-VolumesTestJSON-477488939 None] Deleted volume successfully. Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb6d72b8-a483-4bfa-95ad-a5d9578b1eed tempest-VolumesTestJSON-477488939 None] Lock "cinder-a2fc70a8-2e40-4d20-924d-944799f88206-delete_volume" released by "delete_volume" :: held 3.268s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c9e58721-a391-4b50-9471-c6847b237488 tempest-VolumesTestJSON-477488939 None] Acquiring lock "cinder-ffadcc11-f26d-49d0-9042-f02beec8ceea-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c9e58721-a391-4b50-9471-c6847b237488 tempest-VolumesTestJSON-477488939 None] Lock "cinder-ffadcc11-f26d-49d0-9042-f02beec8ceea-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c9e58721-a391-4b50-9471-c6847b237488 tempest-VolumesTestJSON-477488939 None] Acquiring lock "cinder-quobyte-ffadcc11-f26d-49d0-9042-f02beec8ceea" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c9e58721-a391-4b50-9471-c6847b237488 tempest-VolumesTestJSON-477488939 None] Lock "cinder-quobyte-ffadcc11-f26d-49d0-9042-f02beec8ceea" acquired by "delete_volume" :: waited 0.039s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[701d185b-a48e-423e-bb4d-98b6fa8a0ff9]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c9e58721-a391-4b50-9471-c6847b237488 tempest-VolumesTestJSON-477488939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ffadcc11-f26d-49d0-9042-f02beec8ceea {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Flow 'volume_create_manager' (735e8b61-bb37-479f-bcba-3696d20ed0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04117af4-5031-43a9-8061-aa2527eae0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:15 devstack sudo[84061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ffadcc11-f26d-49d0-9042-f02beec8ceea Feb 27 02:02:15 devstack sudo[84061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04117af4-5031-43a9-8061-aa2527eae0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-672958304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08134f9d-6956-48ac-8645-c37b91c87f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cafb2872bc024a7d86fe04e50217664f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:16Z,use_quota=True,user_id='88c71b9967654559a11fdb830210c80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9aeced-4893-4045-b20f-1baa52916f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9aeced-4893-4045-b20f-1baa52916f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3681b658-4b7a-4d54-9b5c-c05dcdf66c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3681b658-4b7a-4d54-9b5c-c05dcdf66c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08134f9d-6956-48ac-8645-c37b91c87f29', 'volume_name': 'volume-08134f9d-6956-48ac-8645-c37b91c87f29', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b65c0b-d2cc-401a-a450-d2015e104b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b65c0b-d2cc-401a-a450-d2015e104b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a063fa45-2aa1-46a2-ae0c-68718c4ae75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:15 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Volume 08134f9d-6956-48ac-8645-c37b91c87f29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08134f9d-6956-48ac-8645-c37b91c87f29', 'volume_size': 1} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-672958304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08134f9d-6956-48ac-8645-c37b91c87f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cafb2872bc024a7d86fe04e50217664f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:16Z,use_quota=True,user_id='88c71b9967654559a11fdb830210c80b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Creating volume 08134f9d-6956-48ac-8645-c37b91c87f29 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:02:15 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:02:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-08134f9d-6956-48ac-8645-c37b91c87f29 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:15 devstack sudo[84064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-08134f9d-6956-48ac-8645-c37b91c87f29 1073741824 Feb 27 02:02:15 devstack sudo[84064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:16 devstack sudo[84061]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c9e58721-a391-4b50-9471-c6847b237488 tempest-VolumesTestJSON-477488939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ffadcc11-f26d-49d0-9042-f02beec8ceea" returned: 0 in 0.844s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c9e58721-a391-4b50-9471-c6847b237488 tempest-VolumesTestJSON-477488939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ffadcc11-f26d-49d0-9042-f02beec8ceea {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:16 devstack sudo[84072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ffadcc11-f26d-49d0-9042-f02beec8ceea Feb 27 02:02:16 devstack sudo[84072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:17 devstack sudo[84064]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-08134f9d-6956-48ac-8645-c37b91c87f29 1073741824" returned: 0 in 1.079s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-08134f9d-6956-48ac-8645-c37b91c87f29 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:17 devstack sudo[84074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-08134f9d-6956-48ac-8645-c37b91c87f29 Feb 27 02:02:17 devstack sudo[84074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:17 devstack sudo[84072]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c9e58721-a391-4b50-9471-c6847b237488 tempest-VolumesTestJSON-477488939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ffadcc11-f26d-49d0-9042-f02beec8ceea" returned: 0 in 1.281s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c9e58721-a391-4b50-9471-c6847b237488 tempest-VolumesTestJSON-477488939 None] Lock "cinder-quobyte-ffadcc11-f26d-49d0-9042-f02beec8ceea" released by "delete_volume" :: held 2.233s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:17 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-c9e58721-a391-4b50-9471-c6847b237488 tempest-VolumesTestJSON-477488939 None] Created reservations ['d98ff483-f0ef-46d0-bab6-7ccf48e627b2', 'fd45327e-528d-4767-8722-20fa506027d4', '3e377df7-b0c0-41f1-a004-a40bc90284bc', 'f7fc0097-e0a5-4f3c-b0d3-e2af6a793296'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:17 devstack sudo[84074]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-08134f9d-6956-48ac-8645-c37b91c87f29" returned: 0 in 0.867s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] <== create_volume: return (2027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:02:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a063fa45-2aa1-46a2-ae0c-68718c4ae75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08134f9d-6956-48ac-8645-c37b91c87f29', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d239a76c-eb19-4681-bc24-dfd191ea90bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:18 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Volume volume-08134f9d-6956-48ac-8645-c37b91c87f29 (08134f9d-6956-48ac-8645-c37b91c87f29): created successfully Feb 27 02:02:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d239a76c-eb19-4681-bc24-dfd191ea90bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Flow 'volume_create_manager' (735e8b61-bb37-479f-bcba-3696d20ed0b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:18 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-403e678c-bce9-454b-bec0-665b609b3ab7 tempest-ServerRescueNegativeTestJSON-1406914639 None] Created volume successfully. Feb 27 02:02:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c9e58721-a391-4b50-9471-c6847b237488 tempest-VolumesTestJSON-477488939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c9e58721-a391-4b50-9471-c6847b237488 tempest-VolumesTestJSON-477488939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c9e58721-a391-4b50-9471-c6847b237488 tempest-VolumesTestJSON-477488939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c9e58721-a391-4b50-9471-c6847b237488 tempest-VolumesTestJSON-477488939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c9e58721-a391-4b50-9471-c6847b237488 tempest-VolumesTestJSON-477488939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c9e58721-a391-4b50-9471-c6847b237488 tempest-VolumesTestJSON-477488939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:18 devstack sudo[84084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:02:18 devstack sudo[84084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:18 devstack sudo[84084]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c9e58721-a391-4b50-9471-c6847b237488 tempest-VolumesTestJSON-477488939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.731s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:18 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-c9e58721-a391-4b50-9471-c6847b237488 tempest-VolumesTestJSON-477488939 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:18 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c9e58721-a391-4b50-9471-c6847b237488 tempest-VolumesTestJSON-477488939 None] Deleted volume successfully. Feb 27 02:02:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c9e58721-a391-4b50-9471-c6847b237488 tempest-VolumesTestJSON-477488939 None] Lock "cinder-ffadcc11-f26d-49d0-9042-f02beec8ceea-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:23 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-6c51f5de-d120-4602-b08d-de8880ae6fed tempest-GroupsTest-1336330775 None] Group tempest-Group1-448294472: creating Feb 27 02:02:23 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-6c51f5de-d120-4602-b08d-de8880ae6fed tempest-GroupsTest-1336330775 None] Group tempest-Group1-448294472: created successfully Feb 27 02:02:23 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-6c51f5de-d120-4602-b08d-de8880ae6fed tempest-GroupsTest-1336330775 None] Create group completed successfully. Feb 27 02:02:24 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-37838ddc-9c01-48d5-b961-2126c5f1069e tempest-GroupsTest-1336330775 None] Group tempest-Group2-694378095: creating Feb 27 02:02:24 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-37838ddc-9c01-48d5-b961-2126c5f1069e tempest-GroupsTest-1336330775 None] Group tempest-Group2-694378095: created successfully Feb 27 02:02:24 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-37838ddc-9c01-48d5-b961-2126c5f1069e tempest-GroupsTest-1336330775 None] Create group completed successfully. Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Flow 'volume_create_manager' (1367060e-54d2-42fd-8ba7-adbf4238d381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c90b81d-06ba-41cd-82e3-4b065c0e6c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c90b81d-06ba-41cd-82e3-4b065c0e6c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2079883296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=40b9f31f-f566-4da7-922f-e7767cd9eadc,host='devstack@QuobyteHD#QuobyteHD',id=b4a6ccc3-9e9c-462b-b643-8dcd75433fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811fbfad264f409f9ca65cbc4ae00429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:26Z,use_quota=True,user_id='63e17b3547db4d6ab951ec28fea223ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a950ee2-25a3-46bd-b2b1-85d129151d16),volume_type_id=4a950ee2-25a3-46bd-b2b1-85d129151d16)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3cf424-7abb-44a2-8e8b-f02d372a07e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3cf424-7abb-44a2-8e8b-f02d372a07e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a5da93a-ad8b-46ca-9d2a-5ff85071bddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a5da93a-ad8b-46ca-9d2a-5ff85071bddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4a6ccc3-9e9c-462b-b643-8dcd75433fb1', 'volume_name': 'volume-b4a6ccc3-9e9c-462b-b643-8dcd75433fb1', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8df9453-3fd1-4b5c-a8b8-a81d1da6d134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8df9453-3fd1-4b5c-a8b8-a81d1da6d134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d319ef7c-7c73-432d-8a75-a0bd2d1a2c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:25 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Volume b4a6ccc3-9e9c-462b-b643-8dcd75433fb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4a6ccc3-9e9c-462b-b643-8dcd75433fb1', 'volume_size': 1} Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=40b9f31f-f566-4da7-922f-e7767cd9eadc,created_at=2026-02-27T01:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2079883296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=40b9f31f-f566-4da7-922f-e7767cd9eadc,host='devstack@QuobyteHD#QuobyteHD',id=b4a6ccc3-9e9c-462b-b643-8dcd75433fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811fbfad264f409f9ca65cbc4ae00429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:26Z,use_quota=True,user_id='63e17b3547db4d6ab951ec28fea223ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a950ee2-25a3-46bd-b2b1-85d129151d16),volume_type_id=4a950ee2-25a3-46bd-b2b1-85d129151d16)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Creating volume b4a6ccc3-9e9c-462b-b643-8dcd75433fb1 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:02:25 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:02:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-b4a6ccc3-9e9c-462b-b643-8dcd75433fb1 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:26 devstack sudo[84177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-b4a6ccc3-9e9c-462b-b643-8dcd75433fb1 1073741824 Feb 27 02:02:26 devstack sudo[84177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:26 devstack sudo[84177]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-b4a6ccc3-9e9c-462b-b643-8dcd75433fb1 1073741824" returned: 0 in 1.032s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-b4a6ccc3-9e9c-462b-b643-8dcd75433fb1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:27 devstack sudo[84184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-b4a6ccc3-9e9c-462b-b643-8dcd75433fb1 Feb 27 02:02:27 devstack sudo[84184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:27 devstack sudo[84184]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-b4a6ccc3-9e9c-462b-b643-8dcd75433fb1" returned: 0 in 0.709s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:02:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d319ef7c-7c73-432d-8a75-a0bd2d1a2c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4a6ccc3-9e9c-462b-b643-8dcd75433fb1', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99b3ccb-0e5d-4fd5-8ef2-36427ff3c37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:27 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Volume volume-b4a6ccc3-9e9c-462b-b643-8dcd75433fb1 (b4a6ccc3-9e9c-462b-b643-8dcd75433fb1): created successfully Feb 27 02:02:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99b3ccb-0e5d-4fd5-8ef2-36427ff3c37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Flow 'volume_create_manager' (1367060e-54d2-42fd-8ba7-adbf4238d381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:27 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d58c8cd9-a1a7-4e00-9579-3710e3628560 tempest-GroupsTest-1336330775 None] Created volume successfully. Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Flow 'volume_create_manager' (e35e6b60-f561-49fa-812f-ac28b7d453d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86fa2dc7-b915-4ed5-b29c-c1e0b2d144ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86fa2dc7-b915-4ed5-b29c-c1e0b2d144ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1246861534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc3d89b4-977d-4908-abab-030dd2c44ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0334555b67e1473aa41926515703d312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:29Z,use_quota=True,user_id='6e48ec28c1c04ce9af17433f7ea81f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7275106-e9d7-4af2-bcd5-f0502c2804ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7275106-e9d7-4af2-bcd5-f0502c2804ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b8a150-f4a2-4def-8103-4f4c9569c9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b8a150-f4a2-4def-8103-4f4c9569c9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc3d89b4-977d-4908-abab-030dd2c44ea3', 'volume_name': 'volume-cc3d89b4-977d-4908-abab-030dd2c44ea3', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1be516c-7e60-448f-81d7-6a59cc39b714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1be516c-7e60-448f-81d7-6a59cc39b714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f1630b-9e95-4d35-ad63-d27830db01fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:28 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Volume cc3d89b4-977d-4908-abab-030dd2c44ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc3d89b4-977d-4908-abab-030dd2c44ea3', 'volume_size': 1} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1246861534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc3d89b4-977d-4908-abab-030dd2c44ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0334555b67e1473aa41926515703d312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:29Z,use_quota=True,user_id='6e48ec28c1c04ce9af17433f7ea81f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Creating volume cc3d89b4-977d-4908-abab-030dd2c44ea3 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:02:28 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-cc3d89b4-977d-4908-abab-030dd2c44ea3 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:28 devstack sudo[84188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-cc3d89b4-977d-4908-abab-030dd2c44ea3 1073741824 Feb 27 02:02:28 devstack sudo[84188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e2f96329-d1bc-49e9-8e21-3323300875f3 tempest-GroupsTest-1336330775 None] Acquiring lock "cinder-quobyte-b4a6ccc3-9e9c-462b-b643-8dcd75433fb1" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e2f96329-d1bc-49e9-8e21-3323300875f3 tempest-GroupsTest-1336330775 None] Lock "cinder-quobyte-b4a6ccc3-9e9c-462b-b643-8dcd75433fb1" acquired by "delete_volume" :: waited 0.022s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:29 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6032712-7686-4b7a-8ad5-ff8b5e95dd35]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e2f96329-d1bc-49e9-8e21-3323300875f3 tempest-GroupsTest-1336330775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-b4a6ccc3-9e9c-462b-b643-8dcd75433fb1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:29 devstack sudo[84203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-b4a6ccc3-9e9c-462b-b643-8dcd75433fb1 Feb 27 02:02:29 devstack sudo[84203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:30 devstack sudo[84203]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e2f96329-d1bc-49e9-8e21-3323300875f3 tempest-GroupsTest-1336330775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-b4a6ccc3-9e9c-462b-b643-8dcd75433fb1" returned: 0 in 1.066s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e2f96329-d1bc-49e9-8e21-3323300875f3 tempest-GroupsTest-1336330775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-b4a6ccc3-9e9c-462b-b643-8dcd75433fb1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:30 devstack sudo[84228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-b4a6ccc3-9e9c-462b-b643-8dcd75433fb1 Feb 27 02:02:30 devstack sudo[84228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:30 devstack sudo[84188]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-cc3d89b4-977d-4908-abab-030dd2c44ea3 1073741824" returned: 0 in 1.640s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-cc3d89b4-977d-4908-abab-030dd2c44ea3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:30 devstack sudo[84231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-cc3d89b4-977d-4908-abab-030dd2c44ea3 Feb 27 02:02:30 devstack sudo[84231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:30 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:02:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:30 devstack sudo[84234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:02:30 devstack sudo[84234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:31 devstack sudo[84228]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e2f96329-d1bc-49e9-8e21-3323300875f3 tempest-GroupsTest-1336330775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-b4a6ccc3-9e9c-462b-b643-8dcd75433fb1" returned: 0 in 1.116s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e2f96329-d1bc-49e9-8e21-3323300875f3 tempest-GroupsTest-1336330775 None] Lock "cinder-quobyte-b4a6ccc3-9e9c-462b-b643-8dcd75433fb1" released by "delete_volume" :: held 2.252s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:31 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-e2f96329-d1bc-49e9-8e21-3323300875f3 tempest-GroupsTest-1336330775 None] Created reservations ['6f410048-a321-4f42-8115-3a4c303d5647'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:31 devstack cinder-volume[83167]: WARNING cinder.quota [None req-e2f96329-d1bc-49e9-8e21-3323300875f3 tempest-GroupsTest-1336330775 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-737646091 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-737646091, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:02:31 devstack cinder-volume[83167]: WARNING cinder.quota [None req-e2f96329-d1bc-49e9-8e21-3323300875f3 tempest-GroupsTest-1336330775 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-737646091 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-737646091, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:02:31 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-e2f96329-d1bc-49e9-8e21-3323300875f3 tempest-GroupsTest-1336330775 None] Created reservations ['5e34b454-746a-4845-b338-ced3fff7514a', '31cc2782-6a3a-4083-9428-f934d562a7f6', '272f9e00-8205-4f2d-9156-2067de4ab9d3', 'ee575e3b-416a-426e-a91d-005068063401'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:31 devstack sudo[84231]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-cc3d89b4-977d-4908-abab-030dd2c44ea3" returned: 0 in 1.273s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] <== create_volume: return (3016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:02:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.018s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f1630b-9e95-4d35-ad63-d27830db01fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc3d89b4-977d-4908-abab-030dd2c44ea3', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb73700c-1a27-4dde-b248-48960e6a3904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:31 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Volume volume-cc3d89b4-977d-4908-abab-030dd2c44ea3 (cc3d89b4-977d-4908-abab-030dd2c44ea3): created successfully Feb 27 02:02:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb73700c-1a27-4dde-b248-48960e6a3904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Flow 'volume_create_manager' (e35e6b60-f561-49fa-812f-ac28b7d453d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:31 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2bea8671-7fc4-42bc-9611-b079f4064f98 tempest-DeleteServersTestJSON-1707436412 None] Created volume successfully. Feb 27 02:02:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e2f96329-d1bc-49e9-8e21-3323300875f3 tempest-GroupsTest-1336330775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e2f96329-d1bc-49e9-8e21-3323300875f3 tempest-GroupsTest-1336330775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e2f96329-d1bc-49e9-8e21-3323300875f3 tempest-GroupsTest-1336330775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e2f96329-d1bc-49e9-8e21-3323300875f3 tempest-GroupsTest-1336330775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e2f96329-d1bc-49e9-8e21-3323300875f3 tempest-GroupsTest-1336330775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e2f96329-d1bc-49e9-8e21-3323300875f3 tempest-GroupsTest-1336330775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:32 devstack sudo[84237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:02:32 devstack sudo[84237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:32 devstack sudo[84234]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 1.639s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:32 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:32 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-2405dffd-0189-43fb-99c4-f3b9bf01dee5 tempest-GroupsTest-1336330775 None] Created reservations ['27e42226-c5a2-4c59-ac4a-b3e783ced73b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:32 devstack sudo[84237]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e2f96329-d1bc-49e9-8e21-3323300875f3 tempest-GroupsTest-1336330775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.808s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2405dffd-0189-43fb-99c4-f3b9bf01dee5 tempest-GroupsTest-1336330775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2405dffd-0189-43fb-99c4-f3b9bf01dee5 tempest-GroupsTest-1336330775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2405dffd-0189-43fb-99c4-f3b9bf01dee5 tempest-GroupsTest-1336330775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2405dffd-0189-43fb-99c4-f3b9bf01dee5 tempest-GroupsTest-1336330775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2405dffd-0189-43fb-99c4-f3b9bf01dee5 tempest-GroupsTest-1336330775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2405dffd-0189-43fb-99c4-f3b9bf01dee5 tempest-GroupsTest-1336330775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:32 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-e2f96329-d1bc-49e9-8e21-3323300875f3 tempest-GroupsTest-1336330775 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:32 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e2f96329-d1bc-49e9-8e21-3323300875f3 tempest-GroupsTest-1336330775 None] Delete group completed successfully. Feb 27 02:02:32 devstack sudo[84253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:02:32 devstack sudo[84253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:33 devstack sudo[84253]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2405dffd-0189-43fb-99c4-f3b9bf01dee5 tempest-GroupsTest-1336330775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.661s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:33 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-2405dffd-0189-43fb-99c4-f3b9bf01dee5 tempest-GroupsTest-1336330775 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:33 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2405dffd-0189-43fb-99c4-f3b9bf01dee5 tempest-GroupsTest-1336330775 None] Delete group completed successfully. Feb 27 02:02:34 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3856d8fc-1c91-432a-b921-d57bc400223c tempest-GroupsTest-1336330775 None] Group tempest-GroupsTest-Group-1221125619: creating Feb 27 02:02:34 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3856d8fc-1c91-432a-b921-d57bc400223c tempest-GroupsTest-1336330775 None] Group tempest-GroupsTest-Group-1221125619: created successfully Feb 27 02:02:34 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3856d8fc-1c91-432a-b921-d57bc400223c tempest-GroupsTest-1336330775 None] Create group completed successfully. Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Flow 'volume_create_manager' (018de042-fb4b-4255-9fc8-5196656f5ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6b224a-f2c7-4723-abdb-55e6657fcde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6b224a-f2c7-4723-abdb-55e6657fcde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1502021130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17338132-506f-48bb-a74e-b1bd6fc4151e,host='devstack@QuobyteHD#QuobyteHD',id=2fd8fab9-46b5-4017-99bf-cdee2a575c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811fbfad264f409f9ca65cbc4ae00429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:37Z,use_quota=True,user_id='63e17b3547db4d6ab951ec28fea223ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9df17474-184b-481e-a91b-e9166b61b971),volume_type_id=9df17474-184b-481e-a91b-e9166b61b971)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d059c71c-b20d-4546-aee1-50decfd69a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d059c71c-b20d-4546-aee1-50decfd69a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0220c6-ff8f-46ad-bb9a-4bc51807ff7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0220c6-ff8f-46ad-bb9a-4bc51807ff7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fd8fab9-46b5-4017-99bf-cdee2a575c50', 'volume_name': 'volume-2fd8fab9-46b5-4017-99bf-cdee2a575c50', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0bcd1e-c019-4165-85a8-d0ab7d4d7e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0bcd1e-c019-4165-85a8-d0ab7d4d7e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499b2979-44d8-45be-8a1d-55898bb51cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:36 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Volume 2fd8fab9-46b5-4017-99bf-cdee2a575c50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fd8fab9-46b5-4017-99bf-cdee2a575c50', 'volume_size': 1} Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=17338132-506f-48bb-a74e-b1bd6fc4151e,created_at=2026-02-27T01:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1502021130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17338132-506f-48bb-a74e-b1bd6fc4151e,host='devstack@QuobyteHD#QuobyteHD',id=2fd8fab9-46b5-4017-99bf-cdee2a575c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811fbfad264f409f9ca65cbc4ae00429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:37Z,use_quota=True,user_id='63e17b3547db4d6ab951ec28fea223ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9df17474-184b-481e-a91b-e9166b61b971),volume_type_id=9df17474-184b-481e-a91b-e9166b61b971)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Creating volume 2fd8fab9-46b5-4017-99bf-cdee2a575c50 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:02:36 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:02:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2fd8fab9-46b5-4017-99bf-cdee2a575c50 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:36 devstack sudo[84336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2fd8fab9-46b5-4017-99bf-cdee2a575c50 1073741824 Feb 27 02:02:36 devstack sudo[84336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-da39363f-e89c-4cf2-a494-e44273fe270e tempest-ServerRescueNegativeTestJSON-1406914639 None] Acquiring lock "cinder-08134f9d-6956-48ac-8645-c37b91c87f29-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-da39363f-e89c-4cf2-a494-e44273fe270e tempest-ServerRescueNegativeTestJSON-1406914639 None] Lock "cinder-08134f9d-6956-48ac-8645-c37b91c87f29-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-da39363f-e89c-4cf2-a494-e44273fe270e tempest-ServerRescueNegativeTestJSON-1406914639 None] Acquiring lock "cinder-quobyte-08134f9d-6956-48ac-8645-c37b91c87f29" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-da39363f-e89c-4cf2-a494-e44273fe270e tempest-ServerRescueNegativeTestJSON-1406914639 None] Lock "cinder-quobyte-08134f9d-6956-48ac-8645-c37b91c87f29" acquired by "delete_volume" :: waited 0.029s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:38 devstack sudo[84336]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2fd8fab9-46b5-4017-99bf-cdee2a575c50 1073741824" returned: 0 in 2.004s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:38 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acf4e98-a714-4e08-99cb-c297313e95d6]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-da39363f-e89c-4cf2-a494-e44273fe270e tempest-ServerRescueNegativeTestJSON-1406914639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-08134f9d-6956-48ac-8645-c37b91c87f29 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2fd8fab9-46b5-4017-99bf-cdee2a575c50 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:38 devstack sudo[84349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2fd8fab9-46b5-4017-99bf-cdee2a575c50 Feb 27 02:02:38 devstack sudo[84349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:39 devstack sudo[84348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-08134f9d-6956-48ac-8645-c37b91c87f29 Feb 27 02:02:39 devstack sudo[84348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:40 devstack sudo[84349]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2fd8fab9-46b5-4017-99bf-cdee2a575c50" returned: 0 in 1.155s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] <== create_volume: return (3334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:02:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.337s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499b2979-44d8-45be-8a1d-55898bb51cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd8fab9-46b5-4017-99bf-cdee2a575c50', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba395ebe-e3c8-45f7-aed1-0270dfee626b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:40 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Volume volume-2fd8fab9-46b5-4017-99bf-cdee2a575c50 (2fd8fab9-46b5-4017-99bf-cdee2a575c50): created successfully Feb 27 02:02:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba395ebe-e3c8-45f7-aed1-0270dfee626b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Flow 'volume_create_manager' (018de042-fb4b-4255-9fc8-5196656f5ea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:40 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-6913cc28-615b-497c-ad4a-eb5de105a0c5 tempest-GroupsTest-1336330775 None] Created volume successfully. Feb 27 02:02:40 devstack sudo[84348]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-da39363f-e89c-4cf2-a494-e44273fe270e tempest-ServerRescueNegativeTestJSON-1406914639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-08134f9d-6956-48ac-8645-c37b91c87f29" returned: 0 in 1.297s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-da39363f-e89c-4cf2-a494-e44273fe270e tempest-ServerRescueNegativeTestJSON-1406914639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-08134f9d-6956-48ac-8645-c37b91c87f29 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:40 devstack sudo[84366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-08134f9d-6956-48ac-8645-c37b91c87f29 Feb 27 02:02:40 devstack sudo[84366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:40 devstack cinder-volume[83167]: WARNING py.warnings [req-cffb6db4-cbdc-469d-92fa-007b73063a6e req-e4a86236-908d-4e09-b167-29c72a6f6748 tempest-DeleteServersTestJSON-1707436412 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Feb 27 02:02:40 devstack cinder-volume[83167]: .first() Feb 27 02:02:40 devstack cinder-volume[83167]: Feb 27 02:02:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-cffb6db4-cbdc-469d-92fa-007b73063a6e req-e4a86236-908d-4e09-b167-29c72a6f6748 tempest-DeleteServersTestJSON-1707436412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-cffb6db4-cbdc-469d-92fa-007b73063a6e req-e4a86236-908d-4e09-b167-29c72a6f6748 tempest-DeleteServersTestJSON-1707436412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:40 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82d81fa-46d3-4e4c-8b2a-66317bca5117]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-cffb6db4-cbdc-469d-92fa-007b73063a6e req-e4a86236-908d-4e09-b167-29c72a6f6748 tempest-DeleteServersTestJSON-1707436412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-cc3d89b4-977d-4908-abab-030dd2c44ea3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:40 devstack sudo[84369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-cc3d89b4-977d-4908-abab-030dd2c44ea3 Feb 27 02:02:40 devstack sudo[84369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:40 devstack sudo[84366]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-da39363f-e89c-4cf2-a494-e44273fe270e tempest-ServerRescueNegativeTestJSON-1406914639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-08134f9d-6956-48ac-8645-c37b91c87f29" returned: 0 in 0.675s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-da39363f-e89c-4cf2-a494-e44273fe270e tempest-ServerRescueNegativeTestJSON-1406914639 None] Lock "cinder-quobyte-08134f9d-6956-48ac-8645-c37b91c87f29" released by "delete_volume" :: held 2.156s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:40 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-da39363f-e89c-4cf2-a494-e44273fe270e tempest-ServerRescueNegativeTestJSON-1406914639 None] Created reservations ['e7452984-cb07-460b-a9f6-627997e6024e', '79c756c9-9f53-4a2d-8346-deb7e04e7d02', '64533e24-d03f-4367-8003-283cc38e1fe0', 'e1f0ae53-8218-4206-bffe-5f2072381cdd'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-da39363f-e89c-4cf2-a494-e44273fe270e tempest-ServerRescueNegativeTestJSON-1406914639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-da39363f-e89c-4cf2-a494-e44273fe270e tempest-ServerRescueNegativeTestJSON-1406914639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-da39363f-e89c-4cf2-a494-e44273fe270e tempest-ServerRescueNegativeTestJSON-1406914639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-da39363f-e89c-4cf2-a494-e44273fe270e tempest-ServerRescueNegativeTestJSON-1406914639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-da39363f-e89c-4cf2-a494-e44273fe270e tempest-ServerRescueNegativeTestJSON-1406914639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-da39363f-e89c-4cf2-a494-e44273fe270e tempest-ServerRescueNegativeTestJSON-1406914639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:41 devstack sudo[84374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:02:41 devstack sudo[84374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:41 devstack sudo[84369]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-cffb6db4-cbdc-469d-92fa-007b73063a6e req-e4a86236-908d-4e09-b167-29c72a6f6748 tempest-DeleteServersTestJSON-1707436412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-cc3d89b4-977d-4908-abab-030dd2c44ea3" returned: 0 in 1.070s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-cffb6db4-cbdc-469d-92fa-007b73063a6e req-e4a86236-908d-4e09-b167-29c72a6f6748 tempest-DeleteServersTestJSON-1707436412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.114s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-cffb6db4-cbdc-469d-92fa-007b73063a6e req-e4a86236-908d-4e09-b167-29c72a6f6748 tempest-DeleteServersTestJSON-1707436412 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb', 'name': 'volume-cc3d89b4-977d-4908-abab-030dd2c44ea3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28871825-fbec-44c9-9a61-b02c5ac21679', 'enforce_multipath': True} {{(pid=83167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 02:02:41 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-cffb6db4-cbdc-469d-92fa-007b73063a6e req-e4a86236-908d-4e09-b167-29c72a6f6748 tempest-DeleteServersTestJSON-1707436412 None] attachment_update completed successfully. Feb 27 02:02:41 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:02:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Flow 'volume_create_manager' (6583df23-6de6-488f-918f-416f613e87a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb12f24-1c66-422e-aa36-70d36aa689b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb12f24-1c66-422e-aa36-70d36aa689b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-468551521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17338132-506f-48bb-a74e-b1bd6fc4151e,host='devstack@QuobyteHD#QuobyteHD',id=40a59265-48b9-4a4f-a9e0-445c5a9c281f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811fbfad264f409f9ca65cbc4ae00429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:42Z,use_quota=True,user_id='63e17b3547db4d6ab951ec28fea223ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9df17474-184b-481e-a91b-e9166b61b971),volume_type_id=9df17474-184b-481e-a91b-e9166b61b971)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918ace8e-627a-41a4-9990-f4533db342a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918ace8e-627a-41a4-9990-f4533db342a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (810c6836-b8e6-4d81-bd05-7eda1e20da59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (810c6836-b8e6-4d81-bd05-7eda1e20da59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40a59265-48b9-4a4f-a9e0-445c5a9c281f', 'volume_name': 'volume-40a59265-48b9-4a4f-a9e0-445c5a9c281f', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4863474b-f8e0-4812-a3f2-ac5a96465fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4863474b-f8e0-4812-a3f2-ac5a96465fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5aaeb1-5211-49da-8e8b-a4287a039499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:42 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Volume 40a59265-48b9-4a4f-a9e0-445c5a9c281f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40a59265-48b9-4a4f-a9e0-445c5a9c281f', 'volume_size': 1} Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=17338132-506f-48bb-a74e-b1bd6fc4151e,created_at=2026-02-27T01:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-468551521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=17338132-506f-48bb-a74e-b1bd6fc4151e,host='devstack@QuobyteHD#QuobyteHD',id=40a59265-48b9-4a4f-a9e0-445c5a9c281f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811fbfad264f409f9ca65cbc4ae00429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:42Z,use_quota=True,user_id='63e17b3547db4d6ab951ec28fea223ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9df17474-184b-481e-a91b-e9166b61b971),volume_type_id=9df17474-184b-481e-a91b-e9166b61b971)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Creating volume 40a59265-48b9-4a4f-a9e0-445c5a9c281f {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:02:42 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-40a59265-48b9-4a4f-a9e0-445c5a9c281f 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:42 devstack sudo[84380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-40a59265-48b9-4a4f-a9e0-445c5a9c281f 1073741824 Feb 27 02:02:42 devstack sudo[84380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:42 devstack sudo[84374]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-da39363f-e89c-4cf2-a494-e44273fe270e tempest-ServerRescueNegativeTestJSON-1406914639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 1.253s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-da39363f-e89c-4cf2-a494-e44273fe270e tempest-ServerRescueNegativeTestJSON-1406914639 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:42 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-da39363f-e89c-4cf2-a494-e44273fe270e tempest-ServerRescueNegativeTestJSON-1406914639 None] Deleted volume successfully. Feb 27 02:02:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-da39363f-e89c-4cf2-a494-e44273fe270e tempest-ServerRescueNegativeTestJSON-1406914639 None] Lock "cinder-08134f9d-6956-48ac-8645-c37b91c87f29-delete_volume" released by "delete_volume" :: held 3.835s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:43 devstack sudo[84380]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-40a59265-48b9-4a4f-a9e0-445c5a9c281f 1073741824" returned: 0 in 1.563s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-40a59265-48b9-4a4f-a9e0-445c5a9c281f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:43 devstack sudo[84790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-40a59265-48b9-4a4f-a9e0-445c5a9c281f Feb 27 02:02:43 devstack sudo[84790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:44 devstack sudo[84790]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-40a59265-48b9-4a4f-a9e0-445c5a9c281f" returned: 0 in 0.854s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] <== create_volume: return (2584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:02:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.586s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5aaeb1-5211-49da-8e8b-a4287a039499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40a59265-48b9-4a4f-a9e0-445c5a9c281f', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de4da6d-6070-4011-a20c-cf2fc9f767e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:44 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Volume volume-40a59265-48b9-4a4f-a9e0-445c5a9c281f (40a59265-48b9-4a4f-a9e0-445c5a9c281f): created successfully Feb 27 02:02:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de4da6d-6070-4011-a20c-cf2fc9f767e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Flow 'volume_create_manager' (6583df23-6de6-488f-918f-416f613e87a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:44 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ddb67079-0025-475a-9032-36394ff7a866 tempest-GroupsTest-1336330775 None] Created volume successfully. Feb 27 02:02:45 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e84d98d8-58c7-4dfa-b652-c9d0a7a914dd tempest-GroupsTest-1336330775 None] Update group completed successfully. Feb 27 02:02:47 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2a966579-befd-4e66-981f-a7cf8b27a00d tempest-GroupsTest-1336330775 None] Update group completed successfully. Feb 27 02:02:48 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=76,cinder:UPDATE=78,cinder:DELETE=9,cinder:INSERT=18 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:02:48 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:UPDATE=95,cinder:SELECT=69,cinder:INSERT=17,cinder:DELETE=5 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:02:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Acquiring lock "cinder-quobyte-2fd8fab9-46b5-4017-99bf-cdee2a575c50" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Lock "cinder-quobyte-2fd8fab9-46b5-4017-99bf-cdee2a575c50" acquired by "delete_volume" :: waited 0.069s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:48 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[845174a0-8c1c-4c86-8e70-ed68db409993]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2fd8fab9-46b5-4017-99bf-cdee2a575c50 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:48 devstack sudo[84822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2fd8fab9-46b5-4017-99bf-cdee2a575c50 Feb 27 02:02:48 devstack sudo[84822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:49 devstack sudo[84822]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2fd8fab9-46b5-4017-99bf-cdee2a575c50" returned: 0 in 0.611s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2fd8fab9-46b5-4017-99bf-cdee2a575c50 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:49 devstack sudo[84851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2fd8fab9-46b5-4017-99bf-cdee2a575c50 Feb 27 02:02:49 devstack sudo[84851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:49 devstack sudo[84851]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2fd8fab9-46b5-4017-99bf-cdee2a575c50" returned: 0 in 0.696s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Lock "cinder-quobyte-2fd8fab9-46b5-4017-99bf-cdee2a575c50" released by "delete_volume" :: held 1.351s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Acquiring lock "cinder-quobyte-40a59265-48b9-4a4f-a9e0-445c5a9c281f" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Lock "cinder-quobyte-40a59265-48b9-4a4f-a9e0-445c5a9c281f" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:50 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc126ed-b813-4705-a29e-145c7a7c1325]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-40a59265-48b9-4a4f-a9e0-445c5a9c281f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:50 devstack sudo[84857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-40a59265-48b9-4a4f-a9e0-445c5a9c281f Feb 27 02:02:50 devstack sudo[84857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:50 devstack sudo[84857]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-40a59265-48b9-4a4f-a9e0-445c5a9c281f" returned: 0 in 0.628s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-40a59265-48b9-4a4f-a9e0-445c5a9c281f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:50 devstack sudo[84862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-40a59265-48b9-4a4f-a9e0-445c5a9c281f Feb 27 02:02:50 devstack sudo[84862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:51 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-a24f228e-51dc-43c7-b771-7dcbd0667535 req-91f31cda-ff7b-4b1f-a799-7706c996e94a tempest-DeleteServersTestJSON-1707436412 None] Terminate volume connection completed successfully. Feb 27 02:02:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-a24f228e-51dc-43c7-b771-7dcbd0667535 req-91f31cda-ff7b-4b1f-a799-7706c996e94a tempest-DeleteServersTestJSON-1707436412 None] Deleting attachment 28871825-fbec-44c9-9a61-b02c5ac21679. {{(pid=83167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 02:02:51 devstack sudo[84862]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-40a59265-48b9-4a4f-a9e0-445c5a9c281f" returned: 0 in 0.553s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Lock "cinder-quobyte-40a59265-48b9-4a4f-a9e0-445c5a9c281f" released by "delete_volume" :: held 1.224s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:51 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Created reservations ['422fac9f-9a57-45b8-9bf2-f28d373e00b8'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:51 devstack cinder-volume[83167]: WARNING cinder.quota [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2116348983 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2116348983, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:02:51 devstack cinder-volume[83167]: WARNING cinder.quota [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2116348983 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2116348983, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:02:51 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Created reservations ['5c1b3e25-75e5-4756-9678-d556a613375b', 'b872da1b-e9a2-484b-bc6b-939f82baba56', 'eba7d3cd-c3d2-420d-b27c-3cb275f238b8', '1b6cb712-6e50-4804-af8f-4a6c96ceab49'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:51 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Created reservations ['da0949f2-95f6-4824-a9a5-39d25d489554', '57d59c83-fadc-483c-a154-87488f70fd3c', '1b8bb2b7-1f3c-4b9a-a93d-9be819e2eb4d', '76b558ca-fe9d-4b15-86b5-1d6f3c1a5bc0'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:51 devstack sudo[84865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:02:51 devstack sudo[84865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:52 devstack sudo[84865]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.768s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:52 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:52 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-260a853a-436c-42da-8fe5-5ad27a0e1dfe tempest-GroupsTest-1336330775 None] Delete group completed successfully. Feb 27 02:02:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2ed386d9-06e8-4fd8-8e21-8a0d187cfcf4 tempest-DeleteServersTestJSON-1707436412 None] Acquiring lock "cinder-cc3d89b4-977d-4908-abab-030dd2c44ea3-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2ed386d9-06e8-4fd8-8e21-8a0d187cfcf4 tempest-DeleteServersTestJSON-1707436412 None] Lock "cinder-cc3d89b4-977d-4908-abab-030dd2c44ea3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2ed386d9-06e8-4fd8-8e21-8a0d187cfcf4 tempest-DeleteServersTestJSON-1707436412 None] Acquiring lock "cinder-quobyte-cc3d89b4-977d-4908-abab-030dd2c44ea3" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2ed386d9-06e8-4fd8-8e21-8a0d187cfcf4 tempest-DeleteServersTestJSON-1707436412 None] Lock "cinder-quobyte-cc3d89b4-977d-4908-abab-030dd2c44ea3" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:55 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceb87e3-9fe0-451a-bab2-38e38fda73af]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2ed386d9-06e8-4fd8-8e21-8a0d187cfcf4 tempest-DeleteServersTestJSON-1707436412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-cc3d89b4-977d-4908-abab-030dd2c44ea3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:55 devstack sudo[84896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-cc3d89b4-977d-4908-abab-030dd2c44ea3 Feb 27 02:02:55 devstack sudo[84896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:56 devstack sudo[84896]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2ed386d9-06e8-4fd8-8e21-8a0d187cfcf4 tempest-DeleteServersTestJSON-1707436412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-cc3d89b4-977d-4908-abab-030dd2c44ea3" returned: 0 in 0.728s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2ed386d9-06e8-4fd8-8e21-8a0d187cfcf4 tempest-DeleteServersTestJSON-1707436412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-cc3d89b4-977d-4908-abab-030dd2c44ea3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:56 devstack sudo[84902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-cc3d89b4-977d-4908-abab-030dd2c44ea3 Feb 27 02:02:56 devstack sudo[84902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:56 devstack sudo[84902]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2ed386d9-06e8-4fd8-8e21-8a0d187cfcf4 tempest-DeleteServersTestJSON-1707436412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-cc3d89b4-977d-4908-abab-030dd2c44ea3" returned: 0 in 0.532s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2ed386d9-06e8-4fd8-8e21-8a0d187cfcf4 tempest-DeleteServersTestJSON-1707436412 None] Lock "cinder-quobyte-cc3d89b4-977d-4908-abab-030dd2c44ea3" released by "delete_volume" :: held 1.296s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:56 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-2ed386d9-06e8-4fd8-8e21-8a0d187cfcf4 tempest-DeleteServersTestJSON-1707436412 None] Created reservations ['5624399c-199f-46bb-a7ad-96e2a1e9d1d8', '0bae1b32-c88a-4161-a4d4-7176393afc48', '48daaca4-26c1-4a59-bb42-e02529a767d2', 'c7bd97fd-c913-4ccc-ac50-83c24f27d367'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2ed386d9-06e8-4fd8-8e21-8a0d187cfcf4 tempest-DeleteServersTestJSON-1707436412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2ed386d9-06e8-4fd8-8e21-8a0d187cfcf4 tempest-DeleteServersTestJSON-1707436412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2ed386d9-06e8-4fd8-8e21-8a0d187cfcf4 tempest-DeleteServersTestJSON-1707436412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2ed386d9-06e8-4fd8-8e21-8a0d187cfcf4 tempest-DeleteServersTestJSON-1707436412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2ed386d9-06e8-4fd8-8e21-8a0d187cfcf4 tempest-DeleteServersTestJSON-1707436412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2ed386d9-06e8-4fd8-8e21-8a0d187cfcf4 tempest-DeleteServersTestJSON-1707436412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:56 devstack sudo[84905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:02:56 devstack sudo[84905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:57 devstack sudo[84905]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2ed386d9-06e8-4fd8-8e21-8a0d187cfcf4 tempest-DeleteServersTestJSON-1707436412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.703s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:57 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-2ed386d9-06e8-4fd8-8e21-8a0d187cfcf4 tempest-DeleteServersTestJSON-1707436412 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:57 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2ed386d9-06e8-4fd8-8e21-8a0d187cfcf4 tempest-DeleteServersTestJSON-1707436412 None] Deleted volume successfully. Feb 27 02:02:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2ed386d9-06e8-4fd8-8e21-8a0d187cfcf4 tempest-DeleteServersTestJSON-1707436412 None] Lock "cinder-cc3d89b4-977d-4908-abab-030dd2c44ea3-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:59 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-63ce777a-d196-4c9c-8859-b69f56b42e94 tempest-GroupsV320Test-648975868 None] Group tempest-GroupsV320Test-Group-1243383621: creating Feb 27 02:02:59 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-63ce777a-d196-4c9c-8859-b69f56b42e94 tempest-GroupsV320Test-648975868 None] Group tempest-GroupsV320Test-Group-1243383621: created successfully Feb 27 02:02:59 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-63ce777a-d196-4c9c-8859-b69f56b42e94 tempest-GroupsV320Test-648975868 None] Create group completed successfully. Feb 27 02:03:01 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-7925939e-b20a-432c-a13c-c6419908d1fa tempest-GroupsV320Test-648975868 None] Created reservations ['046e4957-d741-4828-aa0a-00bdfbbae7f5'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7925939e-b20a-432c-a13c-c6419908d1fa tempest-GroupsV320Test-648975868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7925939e-b20a-432c-a13c-c6419908d1fa tempest-GroupsV320Test-648975868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7925939e-b20a-432c-a13c-c6419908d1fa tempest-GroupsV320Test-648975868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7925939e-b20a-432c-a13c-c6419908d1fa tempest-GroupsV320Test-648975868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7925939e-b20a-432c-a13c-c6419908d1fa tempest-GroupsV320Test-648975868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7925939e-b20a-432c-a13c-c6419908d1fa tempest-GroupsV320Test-648975868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:01 devstack sudo[84916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:03:01 devstack sudo[84916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:01 devstack sudo[84916]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7925939e-b20a-432c-a13c-c6419908d1fa tempest-GroupsV320Test-648975868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.649s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:01 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-7925939e-b20a-432c-a13c-c6419908d1fa tempest-GroupsV320Test-648975868 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:01 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7925939e-b20a-432c-a13c-c6419908d1fa tempest-GroupsV320Test-648975868 None] Delete group completed successfully. Feb 27 02:03:09 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Flow 'volume_create_manager' (d8fc14b8-45fb-4ea0-b4a6-c0792e7628bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58990730-eb42-4195-8930-cb1861eb8e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58990730-eb42-4195-8930-cb1861eb8e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-96383702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea516ff4-7c21-49e5-a51f-179f61fa3726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89fc47c6ef00418ba3d4488831907fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:10Z,use_quota=True,user_id='bc9891420a5046e5b8cb8ee847d8ca25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8892ff80-195c-46c3-8b1f-21dfbfb70b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8892ff80-195c-46c3-8b1f-21dfbfb70b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8427b66-97a9-49f5-9b10-c61682224848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8427b66-97a9-49f5-9b10-c61682224848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea516ff4-7c21-49e5-a51f-179f61fa3726', 'volume_name': 'volume-ea516ff4-7c21-49e5-a51f-179f61fa3726', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0185e9-42b0-4924-938f-f7b9f9dd4d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0185e9-42b0-4924-938f-f7b9f9dd4d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc894f49-ee4d-4f32-8f8b-befe76e12bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:10 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Volume ea516ff4-7c21-49e5-a51f-179f61fa3726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea516ff4-7c21-49e5-a51f-179f61fa3726', 'volume_size': 1} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-96383702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea516ff4-7c21-49e5-a51f-179f61fa3726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89fc47c6ef00418ba3d4488831907fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:10Z,use_quota=True,user_id='bc9891420a5046e5b8cb8ee847d8ca25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Creating volume ea516ff4-7c21-49e5-a51f-179f61fa3726 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:10 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:10 devstack sudo[84941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726 1073741824 Feb 27 02:03:10 devstack sudo[84941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Flow 'volume_create_manager' (85bcb8ce-366c-42f0-bef0-9753c8c3ee4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430623a6-e4e2-4367-b748-94800315e05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430623a6-e4e2-4367-b748-94800315e05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1410266797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3491ca09-8a98-47f6-ba60-9b22263748b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4323dfe33143a2abef3b8afcde2728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:10Z,use_quota=True,user_id='072b4c3626ab4732ab57d41efee59937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f926c6-f723-4b4f-9a21-7b6bf633b025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f926c6-f723-4b4f-9a21-7b6bf633b025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c49e90-bce5-4bae-86e2-60385c74c33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c49e90-bce5-4bae-86e2-60385c74c33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3491ca09-8a98-47f6-ba60-9b22263748b8', 'volume_name': 'volume-3491ca09-8a98-47f6-ba60-9b22263748b8', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (110e428f-b530-4953-a660-fefbffe3e115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (110e428f-b530-4953-a660-fefbffe3e115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f01c817-88d2-4467-8fd4-b5a54574bbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:10 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Volume 3491ca09-8a98-47f6-ba60-9b22263748b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3491ca09-8a98-47f6-ba60-9b22263748b8', 'volume_size': 1} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:10 devstack sudo[84941]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726 1073741824" returned: 0 in 0.660s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:10 devstack sudo[84946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726 Feb 27 02:03:10 devstack sudo[84946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:11 devstack sudo[84946]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726" returned: 0 in 0.484s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.048s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1410266797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3491ca09-8a98-47f6-ba60-9b22263748b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4323dfe33143a2abef3b8afcde2728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:10Z,use_quota=True,user_id='072b4c3626ab4732ab57d41efee59937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Creating volume 3491ca09-8a98-47f6-ba60-9b22263748b8 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:11 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:03:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc894f49-ee4d-4f32-8f8b-befe76e12bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea516ff4-7c21-49e5-a51f-179f61fa3726', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e9d827-f787-4b57-a4f0-045119039f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:11 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Volume volume-ea516ff4-7c21-49e5-a51f-179f61fa3726 (ea516ff4-7c21-49e5-a51f-179f61fa3726): created successfully Feb 27 02:03:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e9d827-f787-4b57-a4f0-045119039f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Flow 'volume_create_manager' (d8fc14b8-45fb-4ea0-b4a6-c0792e7628bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:11 devstack sudo[84952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8 1073741824 Feb 27 02:03:11 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-c9c86d6b-d6c8-45d5-8f38-f09b2b69f283 req-e20670c6-8e74-471c-bdbc-6b2e7159b1b0 tempest-VolumesSnapshotsTestJSON-1111547626 None] Created volume successfully. Feb 27 02:03:11 devstack sudo[84952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:11 devstack sudo[84952]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8 1073741824" returned: 0 in 0.690s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:11 devstack sudo[84957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8 Feb 27 02:03:11 devstack sudo[84957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-ef54ebea-4337-440b-8e68-c391ed6c3b1f req-c777b69f-a254-4aef-81f3-6798337e286a tempest-VolumesSnapshotsTestJSON-1111547626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:12 devstack sudo[84957]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8" returned: 0 in 0.779s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-ef54ebea-4337-440b-8e68-c391ed6c3b1f req-c777b69f-a254-4aef-81f3-6798337e286a tempest-VolumesSnapshotsTestJSON-1111547626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.222s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [req-ef54ebea-4337-440b-8e68-c391ed6c3b1f req-c777b69f-a254-4aef-81f3-6798337e286a tempest-VolumesSnapshotsTestJSON-1111547626 None] Creating offline snapshot 698ea7c1-8d50-4f47-906b-4079257b07f5 of volume ea516ff4-7c21-49e5-a51f-179f61fa3726 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:03:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f01c817-88d2-4467-8fd4-b5a54574bbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3491ca09-8a98-47f6-ba60-9b22263748b8', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b310ee0-ee0d-4589-a9d1-7ad56586f239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:12 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[781a6189-1f6d-4410-a14b-6cb5bca65f1a]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-ef54ebea-4337-440b-8e68-c391ed6c3b1f req-c777b69f-a254-4aef-81f3-6798337e286a tempest-VolumesSnapshotsTestJSON-1111547626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:12 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Volume volume-3491ca09-8a98-47f6-ba60-9b22263748b8 (3491ca09-8a98-47f6-ba60-9b22263748b8): created successfully Feb 27 02:03:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b310ee0-ee0d-4589-a9d1-7ad56586f239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Flow 'volume_create_manager' (85bcb8ce-366c-42f0-bef0-9753c8c3ee4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:12 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3f3b7e14-0802-4461-b429-00dfb4eb5a1b tempest-SnapshotsActionsTest-260193641 None] Created volume successfully. Feb 27 02:03:12 devstack sudo[84985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726 Feb 27 02:03:12 devstack sudo[84985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:13 devstack sudo[84985]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-ef54ebea-4337-440b-8e68-c391ed6c3b1f req-c777b69f-a254-4aef-81f3-6798337e286a tempest-VolumesSnapshotsTestJSON-1111547626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726" returned: 0 in 0.671s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-ef54ebea-4337-440b-8e68-c391ed6c3b1f req-c777b69f-a254-4aef-81f3-6798337e286a tempest-VolumesSnapshotsTestJSON-1111547626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.698ea7c1-8d50-4f47-906b-4079257b07f5 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:13 devstack sudo[84990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.698ea7c1-8d50-4f47-906b-4079257b07f5 1G Feb 27 02:03:13 devstack sudo[84990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b0dbcb76-ee12-4559-978f-8e81df6da11c tempest-SnapshotsActionsTest-260193641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:14 devstack sudo[84990]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-ef54ebea-4337-440b-8e68-c391ed6c3b1f req-c777b69f-a254-4aef-81f3-6798337e286a tempest-VolumesSnapshotsTestJSON-1111547626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.698ea7c1-8d50-4f47-906b-4079257b07f5 1G" returned: 0 in 0.677s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-ef54ebea-4337-440b-8e68-c391ed6c3b1f req-c777b69f-a254-4aef-81f3-6798337e286a tempest-VolumesSnapshotsTestJSON-1111547626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea516ff4-7c21-49e5-a51f-179f61fa3726 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.698ea7c1-8d50-4f47-906b-4079257b07f5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:14 devstack sudo[84996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea516ff4-7c21-49e5-a51f-179f61fa3726 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.698ea7c1-8d50-4f47-906b-4079257b07f5 Feb 27 02:03:14 devstack sudo[84996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:14 devstack sudo[84996]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-ef54ebea-4337-440b-8e68-c391ed6c3b1f req-c777b69f-a254-4aef-81f3-6798337e286a tempest-VolumesSnapshotsTestJSON-1111547626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea516ff4-7c21-49e5-a51f-179f61fa3726 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.698ea7c1-8d50-4f47-906b-4079257b07f5" returned: 0 in 0.836s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:14 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [req-ef54ebea-4337-440b-8e68-c391ed6c3b1f req-c777b69f-a254-4aef-81f3-6798337e286a tempest-VolumesSnapshotsTestJSON-1111547626 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.698ea7c1-8d50-4f47-906b-4079257b07f5 is being set with open permissions: ugo+rw Feb 27 02:03:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-ef54ebea-4337-440b-8e68-c391ed6c3b1f req-c777b69f-a254-4aef-81f3-6798337e286a tempest-VolumesSnapshotsTestJSON-1111547626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.698ea7c1-8d50-4f47-906b-4079257b07f5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:14 devstack sudo[85004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.698ea7c1-8d50-4f47-906b-4079257b07f5 Feb 27 02:03:15 devstack sudo[85004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:15 devstack sudo[85004]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-ef54ebea-4337-440b-8e68-c391ed6c3b1f req-c777b69f-a254-4aef-81f3-6798337e286a tempest-VolumesSnapshotsTestJSON-1111547626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.698ea7c1-8d50-4f47-906b-4079257b07f5" returned: 0 in 0.545s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-ef54ebea-4337-440b-8e68-c391ed6c3b1f req-c777b69f-a254-4aef-81f3-6798337e286a tempest-VolumesSnapshotsTestJSON-1111547626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:15 devstack sudo[85007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.info Feb 27 02:03:15 devstack sudo[85007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:16 devstack sudo[85007]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-ef54ebea-4337-440b-8e68-c391ed6c3b1f req-c777b69f-a254-4aef-81f3-6798337e286a tempest-VolumesSnapshotsTestJSON-1111547626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.info" returned: 0 in 0.660s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:16 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [req-ef54ebea-4337-440b-8e68-c391ed6c3b1f req-c777b69f-a254-4aef-81f3-6798337e286a tempest-VolumesSnapshotsTestJSON-1111547626 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.info is being set with open permissions: ugo+rw Feb 27 02:03:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-ef54ebea-4337-440b-8e68-c391ed6c3b1f req-c777b69f-a254-4aef-81f3-6798337e286a tempest-VolumesSnapshotsTestJSON-1111547626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:16 devstack sudo[85011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.info Feb 27 02:03:16 devstack sudo[85011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:16 devstack sudo[85011]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-ef54ebea-4337-440b-8e68-c391ed6c3b1f req-c777b69f-a254-4aef-81f3-6798337e286a tempest-VolumesSnapshotsTestJSON-1111547626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.info" returned: 0 in 0.721s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-ef54ebea-4337-440b-8e68-c391ed6c3b1f req-c777b69f-a254-4aef-81f3-6798337e286a tempest-VolumesSnapshotsTestJSON-1111547626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.212s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b0dbcb76-ee12-4559-978f-8e81df6da11c tempest-SnapshotsActionsTest-260193641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.354s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:16 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-ef54ebea-4337-440b-8e68-c391ed6c3b1f req-c777b69f-a254-4aef-81f3-6798337e286a tempest-VolumesSnapshotsTestJSON-1111547626 None] Create snapshot completed successfully Feb 27 02:03:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b0dbcb76-ee12-4559-978f-8e81df6da11c tempest-SnapshotsActionsTest-260193641 None] Creating offline snapshot 492689e9-5259-444c-a864-4b1a74b6daa8 of volume 3491ca09-8a98-47f6-ba60-9b22263748b8 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:03:17 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a720f88-f72d-456c-a50b-b80db04bbaad]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b0dbcb76-ee12-4559-978f-8e81df6da11c tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:17 devstack sudo[85018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8 Feb 27 02:03:17 devstack sudo[85018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:17 devstack sudo[85018]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b0dbcb76-ee12-4559-978f-8e81df6da11c tempest-SnapshotsActionsTest-260193641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8" returned: 0 in 0.634s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b0dbcb76-ee12-4559-978f-8e81df6da11c tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:17 devstack sudo[85024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 1G Feb 27 02:03:17 devstack sudo[85024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] Acquiring lock "cinder-698ea7c1-8d50-4f47-906b-4079257b07f5-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] Lock "cinder-698ea7c1-8d50-4f47-906b-4079257b07f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] Acquiring lock "cinder-quobyte-ea516ff4-7c21-49e5-a51f-179f61fa3726" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] Lock "cinder-quobyte-ea516ff4-7c21-49e5-a51f-179f61fa3726" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] Acquiring lock "cinder-quobyte-698ea7c1-8d50-4f47-906b-4079257b07f5" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] Lock "cinder-quobyte-698ea7c1-8d50-4f47-906b-4079257b07f5" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] Deleting offline snapshot 698ea7c1-8d50-4f47-906b-4079257b07f5 of volume ea516ff4-7c21-49e5-a51f-179f61fa3726 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:03:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] snapshot_file for this snap is: volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.698ea7c1-8d50-4f47-906b-4079257b07f5 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:03:18 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e0582e-a757-4248-992a-1253922672b2]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.698ea7c1-8d50-4f47-906b-4079257b07f5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:18 devstack sudo[85029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.698ea7c1-8d50-4f47-906b-4079257b07f5 Feb 27 02:03:18 devstack sudo[85029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:18 devstack sudo[85024]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b0dbcb76-ee12-4559-978f-8e81df6da11c tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 1G" returned: 0 in 0.739s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b0dbcb76-ee12-4559-978f-8e81df6da11c tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3491ca09-8a98-47f6-ba60-9b22263748b8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:18 devstack sudo[85031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3491ca09-8a98-47f6-ba60-9b22263748b8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 Feb 27 02:03:18 devstack sudo[85031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:18 devstack sudo[85029]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.698ea7c1-8d50-4f47-906b-4079257b07f5" returned: 0 in 0.549s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea516ff4-7c21-49e5-a51f-179f61fa3726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:18 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a2e373-8c9d-4291-8933-cc6b4dd68400]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:18 devstack sudo[85036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726 Feb 27 02:03:18 devstack sudo[85036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:18 devstack sudo[85031]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b0dbcb76-ee12-4559-978f-8e81df6da11c tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3491ca09-8a98-47f6-ba60-9b22263748b8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8" returned: 0 in 0.600s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:18 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b0dbcb76-ee12-4559-978f-8e81df6da11c tempest-SnapshotsActionsTest-260193641 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 is being set with open permissions: ugo+rw Feb 27 02:03:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b0dbcb76-ee12-4559-978f-8e81df6da11c tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:19 devstack sudo[85041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 Feb 27 02:03:19 devstack sudo[85041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:19 devstack sudo[85036]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726" returned: 0 in 0.643s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.698ea7c1-8d50-4f47-906b-4079257b07f5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:19 devstack sudo[85047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.698ea7c1-8d50-4f47-906b-4079257b07f5 Feb 27 02:03:19 devstack sudo[85047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:19 devstack sudo[85041]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b0dbcb76-ee12-4559-978f-8e81df6da11c tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8" returned: 0 in 0.573s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b0dbcb76-ee12-4559-978f-8e81df6da11c tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:19 devstack sudo[85049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.info Feb 27 02:03:19 devstack sudo[85049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:20 devstack sudo[85047]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.698ea7c1-8d50-4f47-906b-4079257b07f5" returned: 0 in 0.617s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.698ea7c1-8d50-4f47-906b-4079257b07f5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:20 devstack sudo[85055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.698ea7c1-8d50-4f47-906b-4079257b07f5 Feb 27 02:03:20 devstack sudo[85055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:20 devstack sudo[85049]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b0dbcb76-ee12-4559-978f-8e81df6da11c tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.info" returned: 0 in 0.542s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:20 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b0dbcb76-ee12-4559-978f-8e81df6da11c tempest-SnapshotsActionsTest-260193641 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.info is being set with open permissions: ugo+rw Feb 27 02:03:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b0dbcb76-ee12-4559-978f-8e81df6da11c tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:20 devstack sudo[85057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.info Feb 27 02:03:20 devstack sudo[85057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:20 devstack sudo[85055]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726.698ea7c1-8d50-4f47-906b-4079257b07f5" returned: 0 in 0.592s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] Lock "cinder-quobyte-698ea7c1-8d50-4f47-906b-4079257b07f5" released by "_delete_snapshot" :: held 2.488s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] Lock "cinder-quobyte-ea516ff4-7c21-49e5-a51f-179f61fa3726" released by "delete_snapshot" :: held 2.508s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:20 devstack sudo[85057]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b0dbcb76-ee12-4559-978f-8e81df6da11c tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.info" returned: 0 in 0.587s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b0dbcb76-ee12-4559-978f-8e81df6da11c tempest-SnapshotsActionsTest-260193641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.788s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:20 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b0dbcb76-ee12-4559-978f-8e81df6da11c tempest-SnapshotsActionsTest-260193641 None] Create snapshot completed successfully Feb 27 02:03:20 devstack cinder-volume[83167]: WARNING cinder.quota [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:03:20 devstack cinder-volume[83167]: DEBUG cinder.quota [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] Created reservations ['142c1914-a5ef-4d47-ba77-911740c2b021', 'c18f1e08-fbe7-4d3b-ba57-c64db8c81ae1', '92a1f133-20aa-4c99-8cca-919c5d4b093e', '1e5157be-c9ac-4464-9c0e-d804c622aa8e'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:20 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] Delete snapshot completed successfully. Feb 27 02:03:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-0e840691-996d-495f-8f89-2a7cd115e066 req-c70444fd-0a0c-4a71-9c13-30c14f87aeb8 tempest-VolumesSnapshotsTestJSON-1111547626 None] Lock "cinder-698ea7c1-8d50-4f47-906b-4079257b07f5-delete_snapshot" released by "delete_snapshot" :: held 2.698s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-b8269486-8e92-4b00-8b22-ab53d528ac0e req-2260e3aa-c837-49fc-8d62-317dad10b1fe tempest-VolumesSnapshotsTestJSON-1111547626 None] Acquiring lock "cinder-ea516ff4-7c21-49e5-a51f-179f61fa3726-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-b8269486-8e92-4b00-8b22-ab53d528ac0e req-2260e3aa-c837-49fc-8d62-317dad10b1fe tempest-VolumesSnapshotsTestJSON-1111547626 None] Lock "cinder-ea516ff4-7c21-49e5-a51f-179f61fa3726-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-b8269486-8e92-4b00-8b22-ab53d528ac0e req-2260e3aa-c837-49fc-8d62-317dad10b1fe tempest-VolumesSnapshotsTestJSON-1111547626 None] Acquiring lock "cinder-quobyte-ea516ff4-7c21-49e5-a51f-179f61fa3726" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-b8269486-8e92-4b00-8b22-ab53d528ac0e req-2260e3aa-c837-49fc-8d62-317dad10b1fe tempest-VolumesSnapshotsTestJSON-1111547626 None] Lock "cinder-quobyte-ea516ff4-7c21-49e5-a51f-179f61fa3726" acquired by "delete_volume" :: waited 0.023s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:21 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5c5c99-0b32-437f-a5e1-0a68430cc8a8]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-b8269486-8e92-4b00-8b22-ab53d528ac0e req-2260e3aa-c837-49fc-8d62-317dad10b1fe tempest-VolumesSnapshotsTestJSON-1111547626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aa1ee806-c187-427a-b63f-3383850453af tempest-SnapshotsActionsTest-260193641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aa1ee806-c187-427a-b63f-3383850453af tempest-SnapshotsActionsTest-260193641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-aa1ee806-c187-427a-b63f-3383850453af tempest-SnapshotsActionsTest-260193641 None] Creating offline snapshot 2621ab41-503d-4ef6-9122-cec75a5d5dfd of volume 3491ca09-8a98-47f6-ba60-9b22263748b8 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:03:21 devstack sudo[85087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726 Feb 27 02:03:21 devstack sudo[85087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:21 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[327fe9ff-4361-46d4-add8-15ab33c09a4e]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa1ee806-c187-427a-b63f-3383850453af tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:22 devstack sudo[85089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 Feb 27 02:03:22 devstack sudo[85089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:22 devstack sudo[85087]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-b8269486-8e92-4b00-8b22-ab53d528ac0e req-2260e3aa-c837-49fc-8d62-317dad10b1fe tempest-VolumesSnapshotsTestJSON-1111547626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726" returned: 0 in 0.951s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-b8269486-8e92-4b00-8b22-ab53d528ac0e req-2260e3aa-c837-49fc-8d62-317dad10b1fe tempest-VolumesSnapshotsTestJSON-1111547626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:22 devstack sudo[85094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726 Feb 27 02:03:22 devstack sudo[85094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:23 devstack sudo[85089]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa1ee806-c187-427a-b63f-3383850453af tempest-SnapshotsActionsTest-260193641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8" returned: 0 in 1.560s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-aa1ee806-c187-427a-b63f-3383850453af tempest-SnapshotsActionsTest-260193641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3491ca09-8a98-47f6-ba60-9b22263748b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa1ee806-c187-427a-b63f-3383850453af tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.2621ab41-503d-4ef6-9122-cec75a5d5dfd 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:23 devstack sudo[85106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.2621ab41-503d-4ef6-9122-cec75a5d5dfd 1G Feb 27 02:03:23 devstack sudo[85106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:23 devstack sudo[85094]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-b8269486-8e92-4b00-8b22-ab53d528ac0e req-2260e3aa-c837-49fc-8d62-317dad10b1fe tempest-VolumesSnapshotsTestJSON-1111547626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea516ff4-7c21-49e5-a51f-179f61fa3726" returned: 0 in 0.997s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-b8269486-8e92-4b00-8b22-ab53d528ac0e req-2260e3aa-c837-49fc-8d62-317dad10b1fe tempest-VolumesSnapshotsTestJSON-1111547626 None] Lock "cinder-quobyte-ea516ff4-7c21-49e5-a51f-179f61fa3726" released by "delete_volume" :: held 2.009s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:23 devstack cinder-volume[83167]: DEBUG cinder.quota [req-b8269486-8e92-4b00-8b22-ab53d528ac0e req-2260e3aa-c837-49fc-8d62-317dad10b1fe tempest-VolumesSnapshotsTestJSON-1111547626 None] Created reservations ['bba9b677-2386-4469-91b3-3a3298fe9af9', 'a7635c7b-de6f-4403-89b1-93d13667dee4', '638efda1-8e1a-46b9-b7ef-b86ec9c5a742', '2901115b-00e6-4c4e-b003-d5f4441533bb'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-b8269486-8e92-4b00-8b22-ab53d528ac0e req-2260e3aa-c837-49fc-8d62-317dad10b1fe tempest-VolumesSnapshotsTestJSON-1111547626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-b8269486-8e92-4b00-8b22-ab53d528ac0e req-2260e3aa-c837-49fc-8d62-317dad10b1fe tempest-VolumesSnapshotsTestJSON-1111547626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-b8269486-8e92-4b00-8b22-ab53d528ac0e req-2260e3aa-c837-49fc-8d62-317dad10b1fe tempest-VolumesSnapshotsTestJSON-1111547626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-b8269486-8e92-4b00-8b22-ab53d528ac0e req-2260e3aa-c837-49fc-8d62-317dad10b1fe tempest-VolumesSnapshotsTestJSON-1111547626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-b8269486-8e92-4b00-8b22-ab53d528ac0e req-2260e3aa-c837-49fc-8d62-317dad10b1fe tempest-VolumesSnapshotsTestJSON-1111547626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-b8269486-8e92-4b00-8b22-ab53d528ac0e req-2260e3aa-c837-49fc-8d62-317dad10b1fe tempest-VolumesSnapshotsTestJSON-1111547626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:24 devstack sudo[85117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:03:24 devstack sudo[85117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:24 devstack sudo[85106]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa1ee806-c187-427a-b63f-3383850453af tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.2621ab41-503d-4ef6-9122-cec75a5d5dfd 1G" returned: 0 in 1.462s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa1ee806-c187-427a-b63f-3383850453af tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.2621ab41-503d-4ef6-9122-cec75a5d5dfd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:24 devstack sudo[85123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.2621ab41-503d-4ef6-9122-cec75a5d5dfd Feb 27 02:03:24 devstack sudo[85123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:25 devstack sudo[85117]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-b8269486-8e92-4b00-8b22-ab53d528ac0e req-2260e3aa-c837-49fc-8d62-317dad10b1fe tempest-VolumesSnapshotsTestJSON-1111547626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 1.181s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:25 devstack cinder-volume[83167]: DEBUG cinder.manager [req-b8269486-8e92-4b00-8b22-ab53d528ac0e req-2260e3aa-c837-49fc-8d62-317dad10b1fe tempest-VolumesSnapshotsTestJSON-1111547626 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:25 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-b8269486-8e92-4b00-8b22-ab53d528ac0e req-2260e3aa-c837-49fc-8d62-317dad10b1fe tempest-VolumesSnapshotsTestJSON-1111547626 None] Deleted volume successfully. Feb 27 02:03:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-b8269486-8e92-4b00-8b22-ab53d528ac0e req-2260e3aa-c837-49fc-8d62-317dad10b1fe tempest-VolumesSnapshotsTestJSON-1111547626 None] Lock "cinder-ea516ff4-7c21-49e5-a51f-179f61fa3726-delete_volume" released by "delete_volume" :: held 3.669s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:25 devstack sudo[85123]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa1ee806-c187-427a-b63f-3383850453af tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.2621ab41-503d-4ef6-9122-cec75a5d5dfd" returned: 0 in 0.909s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:25 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-aa1ee806-c187-427a-b63f-3383850453af tempest-SnapshotsActionsTest-260193641 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.2621ab41-503d-4ef6-9122-cec75a5d5dfd is being set with open permissions: ugo+rw Feb 27 02:03:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa1ee806-c187-427a-b63f-3383850453af tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.2621ab41-503d-4ef6-9122-cec75a5d5dfd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:25 devstack sudo[85129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.2621ab41-503d-4ef6-9122-cec75a5d5dfd Feb 27 02:03:25 devstack sudo[85129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:26 devstack sudo[85129]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aa1ee806-c187-427a-b63f-3383850453af tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.2621ab41-503d-4ef6-9122-cec75a5d5dfd" returned: 0 in 0.584s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aa1ee806-c187-427a-b63f-3383850453af tempest-SnapshotsActionsTest-260193641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.605s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:26 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-aa1ee806-c187-427a-b63f-3383850453af tempest-SnapshotsActionsTest-260193641 None] Create snapshot completed successfully Feb 27 02:03:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] Acquiring lock "cinder-2621ab41-503d-4ef6-9122-cec75a5d5dfd-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-2621ab41-503d-4ef6-9122-cec75a5d5dfd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] Acquiring lock "cinder-quobyte-3491ca09-8a98-47f6-ba60-9b22263748b8" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-quobyte-3491ca09-8a98-47f6-ba60-9b22263748b8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] Acquiring lock "cinder-quobyte-2621ab41-503d-4ef6-9122-cec75a5d5dfd" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-quobyte-2621ab41-503d-4ef6-9122-cec75a5d5dfd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] Deleting offline snapshot 2621ab41-503d-4ef6-9122-cec75a5d5dfd of volume 3491ca09-8a98-47f6-ba60-9b22263748b8 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:03:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] snapshot_file for this snap is: volume-3491ca09-8a98-47f6-ba60-9b22263748b8.2621ab41-503d-4ef6-9122-cec75a5d5dfd {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:03:27 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da20c8c-5c62-47dd-a90c-b840141790e8]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.2621ab41-503d-4ef6-9122-cec75a5d5dfd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:27 devstack sudo[85135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.2621ab41-503d-4ef6-9122-cec75a5d5dfd Feb 27 02:03:27 devstack sudo[85135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:28 devstack sudo[85135]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.2621ab41-503d-4ef6-9122-cec75a5d5dfd" returned: 0 in 0.625s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3491ca09-8a98-47f6-ba60-9b22263748b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:28 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2296001c-bbab-4220-877d-f7afc5096e86]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:28 devstack sudo[85141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 Feb 27 02:03:28 devstack sudo[85141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:28 devstack sudo[85141]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8" returned: 0 in 0.629s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3491ca09-8a98-47f6-ba60-9b22263748b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.2621ab41-503d-4ef6-9122-cec75a5d5dfd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:28 devstack sudo[85149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.2621ab41-503d-4ef6-9122-cec75a5d5dfd Feb 27 02:03:28 devstack sudo[85149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:29 devstack sudo[85149]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.2621ab41-503d-4ef6-9122-cec75a5d5dfd" returned: 0 in 0.639s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.2621ab41-503d-4ef6-9122-cec75a5d5dfd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:29 devstack sudo[85154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.2621ab41-503d-4ef6-9122-cec75a5d5dfd Feb 27 02:03:29 devstack sudo[85154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:30 devstack sudo[85154]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.2621ab41-503d-4ef6-9122-cec75a5d5dfd" returned: 0 in 0.585s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-quobyte-2621ab41-503d-4ef6-9122-cec75a5d5dfd" released by "_delete_snapshot" :: held 2.612s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-quobyte-3491ca09-8a98-47f6-ba60-9b22263748b8" released by "delete_snapshot" :: held 2.638s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:30 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] Created reservations ['26965ff5-5a49-4404-832e-7c3fa67a3f0a', '870f6758-b1ca-4cb0-b086-45024b0bed83', 'e984cec0-689d-4e40-a056-a5a76dd8746e', 'd994d910-2c49-4d61-a9a7-8d5a2c4a6fd0'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:30 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] Delete snapshot completed successfully. Feb 27 02:03:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a73b2be4-8e5e-4ea9-8816-1ebc6df24a47 tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-2621ab41-503d-4ef6-9122-cec75a5d5dfd-delete_snapshot" released by "delete_snapshot" :: held 2.898s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:30 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:03:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:30 devstack sudo[85183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:03:30 devstack sudo[85183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-adc0903a-279f-4bc6-9db9-4b568a6ceb5c tempest-SnapshotsActionsTest-260193641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-adc0903a-279f-4bc6-9db9-4b568a6ceb5c tempest-SnapshotsActionsTest-260193641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-adc0903a-279f-4bc6-9db9-4b568a6ceb5c tempest-SnapshotsActionsTest-260193641 None] Creating offline snapshot fb8fda74-c894-40ec-ac36-f1813a1b8531 of volume 3491ca09-8a98-47f6-ba60-9b22263748b8 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:03:31 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[57872cd6-9e2e-4374-b699-75c8c756d152]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-adc0903a-279f-4bc6-9db9-4b568a6ceb5c tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:31 devstack sudo[85186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 Feb 27 02:03:31 devstack sudo[85186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:32 devstack sudo[85183]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 1.369s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:32 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:32 devstack sudo[85186]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-adc0903a-279f-4bc6-9db9-4b568a6ceb5c tempest-SnapshotsActionsTest-260193641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8" returned: 0 in 1.485s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-adc0903a-279f-4bc6-9db9-4b568a6ceb5c tempest-SnapshotsActionsTest-260193641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3491ca09-8a98-47f6-ba60-9b22263748b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-adc0903a-279f-4bc6-9db9-4b568a6ceb5c tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.fb8fda74-c894-40ec-ac36-f1813a1b8531 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:32 devstack sudo[85193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.fb8fda74-c894-40ec-ac36-f1813a1b8531 1G Feb 27 02:03:32 devstack sudo[85193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:33 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-50dc5f8c-46b9-47b7-a0fc-e74c6c769cb4 tempest-GroupSnapshotsV319Test-1529457669 None] Group tempest-GroupSnapshotsV319Test-Group-1286063928: creating Feb 27 02:03:33 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-50dc5f8c-46b9-47b7-a0fc-e74c6c769cb4 tempest-GroupSnapshotsV319Test-1529457669 None] Group tempest-GroupSnapshotsV319Test-Group-1286063928: created successfully Feb 27 02:03:33 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-50dc5f8c-46b9-47b7-a0fc-e74c6c769cb4 tempest-GroupSnapshotsV319Test-1529457669 None] Create group completed successfully. Feb 27 02:03:33 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Flow 'volume_create_manager' (7aa2b6e8-f9c9-4ab1-a249-977496a58a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30daa02f-1c60-4f59-b841-96929133ede8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30daa02f-1c60-4f59-b841-96929133ede8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:34Z,deleted=False,deleted_at=None,display_description='',display_name='c3206193-cc88-4564-93e7-6a5e0e4eb9a7-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0b3ee1-c974-4777-a3ee-e2f7129f9c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc3912d24584369bb34ad374b7dd153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:34Z,use_quota=True,user_id='dfe3dd27c4734936979324d5de2400aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c3e5cf-91db-4b67-ae2a-18ee2fcd9b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c3e5cf-91db-4b67-ae2a-18ee2fcd9b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a620cbd8-ae62-4ae5-bd2f-6c0b6a8ef846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a620cbd8-ae62-4ae5-bd2f-6c0b6a8ef846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b0b3ee1-c974-4777-a3ee-e2f7129f9c57', 'volume_name': 'volume-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e411cf0-2e29-4955-86b6-433ba6ae905c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e411cf0-2e29-4955-86b6-433ba6ae905c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8756834-d975-4c15-b8cc-01de3f47225b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:34 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Volume 6b0b3ee1-c974-4777-a3ee-e2f7129f9c57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57', 'volume_size': 1} Feb 27 02:03:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:34 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Flow 'volume_create_manager' (b9824502-4823-4bf0-8b0f-2e60f6d213e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74844b2a-0d71-4e37-badf-127c5255e171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74844b2a-0d71-4e37-badf-127c5255e171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1269046352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d854f4bb-47d6-4be5-8943-b5598b56593f,host='devstack@QuobyteHD#QuobyteHD',id=e183658b-2b56-4597-b266-9796879aebdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb91bd863ac44a44a3292a2174e599cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:35Z,use_quota=True,user_id='8802f5bedd3d4d3187704e1c230956ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7530b973-005b-4eb7-9c7f-090503ca2f0b),volume_type_id=7530b973-005b-4eb7-9c7f-090503ca2f0b)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66edfad2-c211-4d11-8cb4-dda200446757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66edfad2-c211-4d11-8cb4-dda200446757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63db9d79-e366-455c-b7b7-560441e9c79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63db9d79-e366-455c-b7b7-560441e9c79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e183658b-2b56-4597-b266-9796879aebdb', 'volume_name': 'volume-e183658b-2b56-4597-b266-9796879aebdb', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc707d33-3a85-4a8a-997f-055041733b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc707d33-3a85-4a8a-997f-055041733b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95961f56-dd63-4fbb-bcb3-b1090a1e2c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:35 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Volume e183658b-2b56-4597-b266-9796879aebdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e183658b-2b56-4597-b266-9796879aebdb', 'volume_size': 1} Feb 27 02:03:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:35 devstack sudo[85193]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-adc0903a-279f-4bc6-9db9-4b568a6ceb5c tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.fb8fda74-c894-40ec-ac36-f1813a1b8531 1G" returned: 0 in 2.470s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-adc0903a-279f-4bc6-9db9-4b568a6ceb5c tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.fb8fda74-c894-40ec-ac36-f1813a1b8531 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:35 devstack sudo[85241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.fb8fda74-c894-40ec-ac36-f1813a1b8531 Feb 27 02:03:35 devstack sudo[85241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:35 devstack sudo[85241]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-adc0903a-279f-4bc6-9db9-4b568a6ceb5c tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.fb8fda74-c894-40ec-ac36-f1813a1b8531" returned: 0 in 0.563s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:35 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-adc0903a-279f-4bc6-9db9-4b568a6ceb5c tempest-SnapshotsActionsTest-260193641 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.fb8fda74-c894-40ec-ac36-f1813a1b8531 is being set with open permissions: ugo+rw Feb 27 02:03:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-adc0903a-279f-4bc6-9db9-4b568a6ceb5c tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.fb8fda74-c894-40ec-ac36-f1813a1b8531 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:35 devstack sudo[85247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.fb8fda74-c894-40ec-ac36-f1813a1b8531 Feb 27 02:03:35 devstack sudo[85247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:36 devstack sudo[85247]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-adc0903a-279f-4bc6-9db9-4b568a6ceb5c tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.fb8fda74-c894-40ec-ac36-f1813a1b8531" returned: 0 in 0.468s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-adc0903a-279f-4bc6-9db9-4b568a6ceb5c tempest-SnapshotsActionsTest-260193641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.147s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.367s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:34Z,deleted=False,deleted_at=None,display_description='',display_name='c3206193-cc88-4564-93e7-6a5e0e4eb9a7-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0b3ee1-c974-4777-a3ee-e2f7129f9c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc3912d24584369bb34ad374b7dd153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:34Z,use_quota=True,user_id='dfe3dd27c4734936979324d5de2400aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Creating volume 6b0b3ee1-c974-4777-a3ee-e2f7129f9c57 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:36 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:36 devstack sudo[85251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57 1073741824 Feb 27 02:03:36 devstack sudo[85251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:36 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-adc0903a-279f-4bc6-9db9-4b568a6ceb5c tempest-SnapshotsActionsTest-260193641 None] Create snapshot completed successfully Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] Acquiring lock "cinder-fb8fda74-c894-40ec-ac36-f1813a1b8531-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-fb8fda74-c894-40ec-ac36-f1813a1b8531-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] Acquiring lock "cinder-quobyte-3491ca09-8a98-47f6-ba60-9b22263748b8" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-quobyte-3491ca09-8a98-47f6-ba60-9b22263748b8" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] Acquiring lock "cinder-quobyte-fb8fda74-c894-40ec-ac36-f1813a1b8531" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-quobyte-fb8fda74-c894-40ec-ac36-f1813a1b8531" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] Deleting offline snapshot fb8fda74-c894-40ec-ac36-f1813a1b8531 of volume 3491ca09-8a98-47f6-ba60-9b22263748b8 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] snapshot_file for this snap is: volume-3491ca09-8a98-47f6-ba60-9b22263748b8.fb8fda74-c894-40ec-ac36-f1813a1b8531 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b43411a-e628-4687-8253-4f9da8a8acfc]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.fb8fda74-c894-40ec-ac36-f1813a1b8531 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:36 devstack sudo[85253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.fb8fda74-c894-40ec-ac36-f1813a1b8531 Feb 27 02:03:36 devstack sudo[85253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:37 devstack sudo[85251]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57 1073741824" returned: 0 in 0.712s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:37 devstack sudo[85258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57 Feb 27 02:03:37 devstack sudo[85258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:37 devstack sudo[85253]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.fb8fda74-c894-40ec-ac36-f1813a1b8531" returned: 0 in 0.920s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3491ca09-8a98-47f6-ba60-9b22263748b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d32c35b-9d8d-4067-bbd1-51ee1b00b5f2]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:37 devstack sudo[85258]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57" returned: 0 in 0.732s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.625s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d854f4bb-47d6-4be5-8943-b5598b56593f,created_at=2026-02-27T01:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1269046352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d854f4bb-47d6-4be5-8943-b5598b56593f,host='devstack@QuobyteHD#QuobyteHD',id=e183658b-2b56-4597-b266-9796879aebdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb91bd863ac44a44a3292a2174e599cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:35Z,use_quota=True,user_id='8802f5bedd3d4d3187704e1c230956ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7530b973-005b-4eb7-9c7f-090503ca2f0b),volume_type_id=7530b973-005b-4eb7-9c7f-090503ca2f0b)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Creating volume e183658b-2b56-4597-b266-9796879aebdb {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:37 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8756834-d975-4c15-b8cc-01de3f47225b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37daa2b8-2879-4a77-80b4-f45a28f228e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:37 devstack sudo[85274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 Feb 27 02:03:37 devstack sudo[85274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:37 devstack sudo[85276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb 1073741824 Feb 27 02:03:37 devstack sudo[85276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:37 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Volume volume-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57 (6b0b3ee1-c974-4777-a3ee-e2f7129f9c57): created successfully Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37daa2b8-2879-4a77-80b4-f45a28f228e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Flow 'volume_create_manager' (7aa2b6e8-f9c9-4ab1-a249-977496a58a8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:37 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-60727426-6c4d-4181-88ef-144761add600 req-70c4013c-bb10-4cf9-9345-49eb05cbb90a tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Created volume successfully. Feb 27 02:03:38 devstack sudo[85274]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8" returned: 0 in 0.741s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3491ca09-8a98-47f6-ba60-9b22263748b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.fb8fda74-c894-40ec-ac36-f1813a1b8531 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:38 devstack sudo[85288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.fb8fda74-c894-40ec-ac36-f1813a1b8531 Feb 27 02:03:38 devstack sudo[85288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:38 devstack sudo[85276]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb 1073741824" returned: 0 in 0.688s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:38 devstack sudo[85290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb Feb 27 02:03:38 devstack sudo[85290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:39 devstack sudo[85288]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.fb8fda74-c894-40ec-ac36-f1813a1b8531" returned: 0 in 0.618s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.fb8fda74-c894-40ec-ac36-f1813a1b8531 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:39 devstack sudo[85295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.fb8fda74-c894-40ec-ac36-f1813a1b8531 Feb 27 02:03:39 devstack sudo[85295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:39 devstack sudo[85290]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb" returned: 0 in 0.627s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95961f56-dd63-4fbb-bcb3-b1090a1e2c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e183658b-2b56-4597-b266-9796879aebdb', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71af7c83-073f-46ee-9eb7-8692c508d30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:39 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Volume volume-e183658b-2b56-4597-b266-9796879aebdb (e183658b-2b56-4597-b266-9796879aebdb): created successfully Feb 27 02:03:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71af7c83-073f-46ee-9eb7-8692c508d30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Flow 'volume_create_manager' (b9824502-4823-4bf0-8b0f-2e60f6d213e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:39 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-05a7a10f-c93c-4376-8a93-3499ae07db6d tempest-GroupSnapshotsV319Test-1529457669 None] Created volume successfully. Feb 27 02:03:39 devstack sudo[85295]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.fb8fda74-c894-40ec-ac36-f1813a1b8531" returned: 0 in 0.572s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-quobyte-fb8fda74-c894-40ec-ac36-f1813a1b8531" released by "_delete_snapshot" :: held 2.919s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-quobyte-3491ca09-8a98-47f6-ba60-9b22263748b8" released by "delete_snapshot" :: held 2.945s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:39 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] Created reservations ['9ec16673-565a-4807-9004-88cffcfdc076', '78ec2007-bd67-4c00-85d1-ee35ac7dcac3', 'd25962e5-3cc8-464c-b15d-c03d4bc6eae6', '080cbe3a-5aa9-4090-b6e5-95f4ef4e14a7'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:39 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] Delete snapshot completed successfully. Feb 27 02:03:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-729ed828-f4ee-46dd-bea5-67ae6d757706 tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-fb8fda74-c894-40ec-ac36-f1813a1b8531-delete_snapshot" released by "delete_snapshot" :: held 3.038s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9662829d-6b07-4e83-a36d-6b146ae40e70 tempest-SnapshotsActionsTest-260193641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9662829d-6b07-4e83-a36d-6b146ae40e70 tempest-SnapshotsActionsTest-260193641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.023s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-9662829d-6b07-4e83-a36d-6b146ae40e70 tempest-SnapshotsActionsTest-260193641 None] Creating offline snapshot 9396b0b2-4bfb-492d-9087-31c18cb38f9f of volume 3491ca09-8a98-47f6-ba60-9b22263748b8 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:03:40 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44e8334-265c-4200-a379-57b2caaf8936]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9662829d-6b07-4e83-a36d-6b146ae40e70 tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-60727426-6c4d-4181-88ef-144761add600 req-664aea86-704f-474b-a126-9e38231fc103 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:40 devstack sudo[85310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 Feb 27 02:03:40 devstack sudo[85310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:41 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] GroupSnapshot bc1c72eb-9596-41b6-8ff3-3c9a75079dd2: creating. Feb 27 02:03:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] Group snapshot bc1c72eb-9596-41b6-8ff3-3c9a75079dd2: creating. {{(pid=83167) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 02:03:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:41 devstack sudo[85310]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9662829d-6b07-4e83-a36d-6b146ae40e70 tempest-SnapshotsActionsTest-260193641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8" returned: 0 in 0.988s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-9662829d-6b07-4e83-a36d-6b146ae40e70 tempest-SnapshotsActionsTest-260193641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3491ca09-8a98-47f6-ba60-9b22263748b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9662829d-6b07-4e83-a36d-6b146ae40e70 tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.9396b0b2-4bfb-492d-9087-31c18cb38f9f 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:41 devstack sudo[85316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.9396b0b2-4bfb-492d-9087-31c18cb38f9f 1G Feb 27 02:03:41 devstack sudo[85316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:42 devstack sudo[85316]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9662829d-6b07-4e83-a36d-6b146ae40e70 tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.9396b0b2-4bfb-492d-9087-31c18cb38f9f 1G" returned: 0 in 0.970s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9662829d-6b07-4e83-a36d-6b146ae40e70 tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.9396b0b2-4bfb-492d-9087-31c18cb38f9f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:42 devstack sudo[85336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.9396b0b2-4bfb-492d-9087-31c18cb38f9f Feb 27 02:03:42 devstack sudo[85336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:43 devstack sudo[85336]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9662829d-6b07-4e83-a36d-6b146ae40e70 tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.9396b0b2-4bfb-492d-9087-31c18cb38f9f" returned: 0 in 0.564s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:43 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-9662829d-6b07-4e83-a36d-6b146ae40e70 tempest-SnapshotsActionsTest-260193641 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.9396b0b2-4bfb-492d-9087-31c18cb38f9f is being set with open permissions: ugo+rw Feb 27 02:03:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9662829d-6b07-4e83-a36d-6b146ae40e70 tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.9396b0b2-4bfb-492d-9087-31c18cb38f9f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:43 devstack sudo[85341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.9396b0b2-4bfb-492d-9087-31c18cb38f9f Feb 27 02:03:43 devstack sudo[85341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:43 devstack sudo[85341]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9662829d-6b07-4e83-a36d-6b146ae40e70 tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.9396b0b2-4bfb-492d-9087-31c18cb38f9f" returned: 0 in 0.528s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9662829d-6b07-4e83-a36d-6b146ae40e70 tempest-SnapshotsActionsTest-260193641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.245s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-60727426-6c4d-4181-88ef-144761add600 req-664aea86-704f-474b-a126-9e38231fc103 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.978s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:43 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29d68df-22f9-4b37-b826-1af2f265810a]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-60727426-6c4d-4181-88ef-144761add600 req-664aea86-704f-474b-a126-9e38231fc103 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:43 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-9662829d-6b07-4e83-a36d-6b146ae40e70 tempest-SnapshotsActionsTest-260193641 None] Create snapshot completed successfully Feb 27 02:03:43 devstack sudo[85344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57 Feb 27 02:03:43 devstack sudo[85344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:44 devstack sudo[85344]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-60727426-6c4d-4181-88ef-144761add600 req-664aea86-704f-474b-a126-9e38231fc103 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57" returned: 0 in 0.578s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-60727426-6c4d-4181-88ef-144761add600 req-664aea86-704f-474b-a126-9e38231fc103 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.592s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] Creating offline snapshot 739da106-54a8-4ad3-904e-5e98dfe3cf45 of volume e183658b-2b56-4597-b266-9796879aebdb {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:03:44 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1623185d-cce7-46de-9e51-d3fd7361f765]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-60727426-6c4d-4181-88ef-144761add600 req-664aea86-704f-474b-a126-9e38231fc103 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb', 'name': 'volume-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb370515-a693-403c-945e-546b391b3381', 'enforce_multipath': True} {{(pid=83167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 02:03:44 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-60727426-6c4d-4181-88ef-144761add600 req-664aea86-704f-474b-a126-9e38231fc103 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] attachment_update completed successfully. Feb 27 02:03:44 devstack sudo[85349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb Feb 27 02:03:44 devstack sudo[85349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] Acquiring lock "cinder-9396b0b2-4bfb-492d-9087-31c18cb38f9f-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-9396b0b2-4bfb-492d-9087-31c18cb38f9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] Acquiring lock "cinder-quobyte-3491ca09-8a98-47f6-ba60-9b22263748b8" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-quobyte-3491ca09-8a98-47f6-ba60-9b22263748b8" acquired by "delete_snapshot" :: waited 0.036s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] Acquiring lock "cinder-quobyte-9396b0b2-4bfb-492d-9087-31c18cb38f9f" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-quobyte-9396b0b2-4bfb-492d-9087-31c18cb38f9f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] Deleting offline snapshot 9396b0b2-4bfb-492d-9087-31c18cb38f9f of volume 3491ca09-8a98-47f6-ba60-9b22263748b8 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:03:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] snapshot_file for this snap is: volume-3491ca09-8a98-47f6-ba60-9b22263748b8.9396b0b2-4bfb-492d-9087-31c18cb38f9f {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:03:44 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d456d3a-1f0b-4118-9877-aa52269f9e92]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.9396b0b2-4bfb-492d-9087-31c18cb38f9f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:44 devstack sudo[85351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.9396b0b2-4bfb-492d-9087-31c18cb38f9f Feb 27 02:03:44 devstack sudo[85351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:45 devstack sudo[85349]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb" returned: 0 in 0.818s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.739da106-54a8-4ad3-904e-5e98dfe3cf45 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:45 devstack sudo[85356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.739da106-54a8-4ad3-904e-5e98dfe3cf45 1G Feb 27 02:03:45 devstack sudo[85356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:45 devstack sudo[85351]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.9396b0b2-4bfb-492d-9087-31c18cb38f9f" returned: 0 in 0.688s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3491ca09-8a98-47f6-ba60-9b22263748b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:45 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da4af68-4efb-49ec-9505-c3274d401d49]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:45 devstack sudo[85361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 Feb 27 02:03:45 devstack sudo[85361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:45 devstack sudo[85356]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.739da106-54a8-4ad3-904e-5e98dfe3cf45 1G" returned: 0 in 0.601s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e183658b-2b56-4597-b266-9796879aebdb -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.739da106-54a8-4ad3-904e-5e98dfe3cf45 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:45 devstack sudo[85369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e183658b-2b56-4597-b266-9796879aebdb -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.739da106-54a8-4ad3-904e-5e98dfe3cf45 Feb 27 02:03:45 devstack sudo[85369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:46 devstack sudo[85361]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8" returned: 0 in 0.628s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3491ca09-8a98-47f6-ba60-9b22263748b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.9396b0b2-4bfb-492d-9087-31c18cb38f9f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:46 devstack sudo[85374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.9396b0b2-4bfb-492d-9087-31c18cb38f9f Feb 27 02:03:46 devstack sudo[85374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:46 devstack sudo[85369]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e183658b-2b56-4597-b266-9796879aebdb -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.739da106-54a8-4ad3-904e-5e98dfe3cf45" returned: 0 in 0.849s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:46 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.739da106-54a8-4ad3-904e-5e98dfe3cf45 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:03:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.739da106-54a8-4ad3-904e-5e98dfe3cf45 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:46 devstack sudo[85425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.739da106-54a8-4ad3-904e-5e98dfe3cf45 Feb 27 02:03:46 devstack sudo[85425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:46 devstack sudo[85374]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.9396b0b2-4bfb-492d-9087-31c18cb38f9f" returned: 0 in 0.788s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.9396b0b2-4bfb-492d-9087-31c18cb38f9f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:46 devstack sudo[85451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.9396b0b2-4bfb-492d-9087-31c18cb38f9f Feb 27 02:03:46 devstack sudo[85451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:47 devstack sudo[85425]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.739da106-54a8-4ad3-904e-5e98dfe3cf45" returned: 0 in 0.507s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:47 devstack sudo[85456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.info Feb 27 02:03:47 devstack sudo[85456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:47 devstack sudo[85451]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.9396b0b2-4bfb-492d-9087-31c18cb38f9f" returned: 0 in 0.634s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-quobyte-9396b0b2-4bfb-492d-9087-31c18cb38f9f" released by "_delete_snapshot" :: held 2.834s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-quobyte-3491ca09-8a98-47f6-ba60-9b22263748b8" released by "delete_snapshot" :: held 2.874s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:47 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] Created reservations ['001e734e-8eb4-43a8-80a5-dd486b4d7490', 'babdbb08-62dd-4b5a-a232-567fbb28658c', 'c72db4fe-c3f3-4fe3-af3a-9086fcc25af2', '35343326-16a3-4871-9b0a-a10bbd0b5711'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:47 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] Delete snapshot completed successfully. Feb 27 02:03:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98275cb3-3af9-436c-9cf0-69504eff30eb tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-9396b0b2-4bfb-492d-9087-31c18cb38f9f-delete_snapshot" released by "delete_snapshot" :: held 3.236s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:48 devstack sudo[85456]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.info" returned: 0 in 1.253s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:48 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:03:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:48 devstack sudo[85486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.info Feb 27 02:03:48 devstack sudo[85486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5b8be6a8-138c-4c1a-a564-31d721cc5cb6 tempest-SnapshotsActionsTest-260193641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:49 devstack sudo[85486]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.info" returned: 0 in 0.635s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.733s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5b8be6a8-138c-4c1a-a564-31d721cc5cb6 tempest-SnapshotsActionsTest-260193641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.442s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:49 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=80,cinder:UPDATE=97,cinder:INSERT=22,cinder:DELETE=6 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:03:49 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=88,cinder:UPDATE=67,cinder:INSERT=19,cinder:DELETE=5 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:03:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-5b8be6a8-138c-4c1a-a564-31d721cc5cb6 tempest-SnapshotsActionsTest-260193641 None] Creating offline snapshot be409673-e451-47b6-b378-9cb480c291af of volume 3491ca09-8a98-47f6-ba60-9b22263748b8 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:03:49 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c93cc4-7a2d-4455-bafb-636e095ad56f]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5b8be6a8-138c-4c1a-a564-31d721cc5cb6 tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:49 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a74669ac-d8c5-4be0-90b9-a41ef483be9e tempest-GroupSnapshotsV319Test-1529457669 None] group_snapshot bc1c72eb-9596-41b6-8ff3-3c9a75079dd2: created successfully Feb 27 02:03:49 devstack sudo[85490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 Feb 27 02:03:49 devstack sudo[85490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:50 devstack sudo[85490]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5b8be6a8-138c-4c1a-a564-31d721cc5cb6 tempest-SnapshotsActionsTest-260193641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8" returned: 0 in 1.079s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-5b8be6a8-138c-4c1a-a564-31d721cc5cb6 tempest-SnapshotsActionsTest-260193641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3491ca09-8a98-47f6-ba60-9b22263748b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5b8be6a8-138c-4c1a-a564-31d721cc5cb6 tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.be409673-e451-47b6-b378-9cb480c291af 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:50 devstack sudo[85828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.be409673-e451-47b6-b378-9cb480c291af 1G Feb 27 02:03:50 devstack sudo[85828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:50 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] group_snapshot bc1c72eb-9596-41b6-8ff3-3c9a75079dd2: deleting Feb 27 02:03:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] group_snapshot bc1c72eb-9596-41b6-8ff3-3c9a75079dd2: deleting {{(pid=83167) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 02:03:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] Acquiring lock "cinder-quobyte-e183658b-2b56-4597-b266-9796879aebdb" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] Lock "cinder-quobyte-e183658b-2b56-4597-b266-9796879aebdb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] Acquiring lock "cinder-quobyte-739da106-54a8-4ad3-904e-5e98dfe3cf45" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] Lock "cinder-quobyte-739da106-54a8-4ad3-904e-5e98dfe3cf45" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] Deleting offline snapshot 739da106-54a8-4ad3-904e-5e98dfe3cf45 of volume e183658b-2b56-4597-b266-9796879aebdb {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:03:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] snapshot_file for this snap is: volume-e183658b-2b56-4597-b266-9796879aebdb.739da106-54a8-4ad3-904e-5e98dfe3cf45 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:03:50 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fae437a-d6b8-4724-b543-02ae6c3d8149]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.739da106-54a8-4ad3-904e-5e98dfe3cf45 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:50 devstack sudo[85834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.739da106-54a8-4ad3-904e-5e98dfe3cf45 Feb 27 02:03:50 devstack sudo[85834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:51 devstack sudo[85834]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.739da106-54a8-4ad3-904e-5e98dfe3cf45" returned: 0 in 0.880s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e183658b-2b56-4597-b266-9796879aebdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:51 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c310ed4-fef0-4ad5-b387-27c1b818163a]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:51 devstack sudo[85828]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5b8be6a8-138c-4c1a-a564-31d721cc5cb6 tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.be409673-e451-47b6-b378-9cb480c291af 1G" returned: 0 in 1.647s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5b8be6a8-138c-4c1a-a564-31d721cc5cb6 tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.be409673-e451-47b6-b378-9cb480c291af {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:51 devstack sudo[85842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb Feb 27 02:03:51 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:51 devstack sudo[85844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.be409673-e451-47b6-b378-9cb480c291af Feb 27 02:03:51 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:52 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5b8be6a8-138c-4c1a-a564-31d721cc5cb6 tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.be409673-e451-47b6-b378-9cb480c291af" returned: 0 in 0.560s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:52 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-5b8be6a8-138c-4c1a-a564-31d721cc5cb6 tempest-SnapshotsActionsTest-260193641 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.be409673-e451-47b6-b378-9cb480c291af is being set with open permissions: ugo+rw Feb 27 02:03:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5b8be6a8-138c-4c1a-a564-31d721cc5cb6 tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.be409673-e451-47b6-b378-9cb480c291af {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:52 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb" returned: 0 in 0.700s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.739da106-54a8-4ad3-904e-5e98dfe3cf45 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:52 devstack sudo[85853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.739da106-54a8-4ad3-904e-5e98dfe3cf45 Feb 27 02:03:52 devstack sudo[85853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:52 devstack sudo[85852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.be409673-e451-47b6-b378-9cb480c291af Feb 27 02:03:52 devstack sudo[85852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:52 devstack sudo[85852]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5b8be6a8-138c-4c1a-a564-31d721cc5cb6 tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.be409673-e451-47b6-b378-9cb480c291af" returned: 0 in 0.569s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5b8be6a8-138c-4c1a-a564-31d721cc5cb6 tempest-SnapshotsActionsTest-260193641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.943s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:53 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-5b8be6a8-138c-4c1a-a564-31d721cc5cb6 tempest-SnapshotsActionsTest-260193641 None] Create snapshot completed successfully Feb 27 02:03:53 devstack sudo[85853]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.739da106-54a8-4ad3-904e-5e98dfe3cf45" returned: 0 in 0.691s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.739da106-54a8-4ad3-904e-5e98dfe3cf45 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:53 devstack sudo[85882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.739da106-54a8-4ad3-904e-5e98dfe3cf45 Feb 27 02:03:53 devstack sudo[85882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:53 devstack sudo[85882]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb.739da106-54a8-4ad3-904e-5e98dfe3cf45" returned: 0 in 0.524s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] Lock "cinder-quobyte-739da106-54a8-4ad3-904e-5e98dfe3cf45" released by "_delete_snapshot" :: held 3.007s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] Lock "cinder-quobyte-e183658b-2b56-4597-b266-9796879aebdb" released by "delete_snapshot" :: held 3.041s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:53 devstack cinder-volume[83167]: WARNING cinder.quota [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-895654054 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-895654054, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:03:53 devstack cinder-volume[83167]: WARNING cinder.quota [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-895654054 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-895654054, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:03:53 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] Created reservations ['559d2a7f-9820-4f3d-a15d-6bd183fe09e7', '85c9a77a-591c-45bf-9234-c9df4b589949', '0158c948-25b9-4c49-9d86-e6f9d5ef37cc', '3e9d9d44-5e2f-4d38-b832-09bef6005175'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:53 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d3024b77-8e9f-4908-8a88-035990cb360a tempest-GroupSnapshotsV319Test-1529457669 None] group_snapshot bc1c72eb-9596-41b6-8ff3-3c9a75079dd2: deleted successfully Feb 27 02:03:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] Acquiring lock "cinder-be409673-e451-47b6-b378-9cb480c291af-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-be409673-e451-47b6-b378-9cb480c291af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] Acquiring lock "cinder-quobyte-3491ca09-8a98-47f6-ba60-9b22263748b8" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-quobyte-3491ca09-8a98-47f6-ba60-9b22263748b8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] Acquiring lock "cinder-quobyte-be409673-e451-47b6-b378-9cb480c291af" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-quobyte-be409673-e451-47b6-b378-9cb480c291af" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] Deleting offline snapshot be409673-e451-47b6-b378-9cb480c291af of volume 3491ca09-8a98-47f6-ba60-9b22263748b8 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:03:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] snapshot_file for this snap is: volume-3491ca09-8a98-47f6-ba60-9b22263748b8.be409673-e451-47b6-b378-9cb480c291af {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:03:54 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f85ba77-54e2-4ab2-a50e-cedcdfde5c04]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.be409673-e451-47b6-b378-9cb480c291af {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:54 devstack sudo[85886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.be409673-e451-47b6-b378-9cb480c291af Feb 27 02:03:54 devstack sudo[85886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-35d9919a-3af0-4732-8ad7-1f7ec7678766 tempest-GroupSnapshotsV319Test-1529457669 None] Acquiring lock "cinder-quobyte-e183658b-2b56-4597-b266-9796879aebdb" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-35d9919a-3af0-4732-8ad7-1f7ec7678766 tempest-GroupSnapshotsV319Test-1529457669 None] Lock "cinder-quobyte-e183658b-2b56-4597-b266-9796879aebdb" acquired by "delete_volume" :: waited 0.020s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:54 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a39e82c-daa1-407a-83a4-d0986c769afb]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-35d9919a-3af0-4732-8ad7-1f7ec7678766 tempest-GroupSnapshotsV319Test-1529457669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:54 devstack sudo[85888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb Feb 27 02:03:54 devstack sudo[85888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:54 devstack sudo[85886]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.be409673-e451-47b6-b378-9cb480c291af" returned: 0 in 0.780s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3491ca09-8a98-47f6-ba60-9b22263748b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:54 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7789a049-35c8-4314-b9e0-b3cae935e30d]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:54 devstack sudo[85895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 Feb 27 02:03:54 devstack sudo[85895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:55 devstack sudo[85888]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-35d9919a-3af0-4732-8ad7-1f7ec7678766 tempest-GroupSnapshotsV319Test-1529457669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb" returned: 0 in 0.838s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-35d9919a-3af0-4732-8ad7-1f7ec7678766 tempest-GroupSnapshotsV319Test-1529457669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:55 devstack sudo[85900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb Feb 27 02:03:55 devstack sudo[85900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:55 devstack sudo[85895]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8" returned: 0 in 0.579s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3491ca09-8a98-47f6-ba60-9b22263748b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.be409673-e451-47b6-b378-9cb480c291af {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:55 devstack sudo[85905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.be409673-e451-47b6-b378-9cb480c291af Feb 27 02:03:55 devstack sudo[85905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:55 devstack sudo[85900]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-35d9919a-3af0-4732-8ad7-1f7ec7678766 tempest-GroupSnapshotsV319Test-1529457669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e183658b-2b56-4597-b266-9796879aebdb" returned: 0 in 0.493s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-35d9919a-3af0-4732-8ad7-1f7ec7678766 tempest-GroupSnapshotsV319Test-1529457669 None] Lock "cinder-quobyte-e183658b-2b56-4597-b266-9796879aebdb" released by "delete_volume" :: held 1.394s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:55 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-35d9919a-3af0-4732-8ad7-1f7ec7678766 tempest-GroupSnapshotsV319Test-1529457669 None] Created reservations ['cbe6d4b9-afd0-4502-9605-3d171f6674bf'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:55 devstack cinder-volume[83167]: WARNING cinder.quota [None req-35d9919a-3af0-4732-8ad7-1f7ec7678766 tempest-GroupSnapshotsV319Test-1529457669 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-895654054 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-895654054, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:03:55 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-35d9919a-3af0-4732-8ad7-1f7ec7678766 tempest-GroupSnapshotsV319Test-1529457669 None] Created reservations ['ebe8133b-62e9-4ebf-b903-cd70ee1e7913', '43c4b066-f564-40d3-b484-41c1aa784bd3', '2371c04f-ba9e-4893-a4a2-13dea908bcf0', '20b431ad-74dd-4eac-8353-126651e38b94'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-35d9919a-3af0-4732-8ad7-1f7ec7678766 tempest-GroupSnapshotsV319Test-1529457669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-35d9919a-3af0-4732-8ad7-1f7ec7678766 tempest-GroupSnapshotsV319Test-1529457669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-35d9919a-3af0-4732-8ad7-1f7ec7678766 tempest-GroupSnapshotsV319Test-1529457669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-35d9919a-3af0-4732-8ad7-1f7ec7678766 tempest-GroupSnapshotsV319Test-1529457669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-35d9919a-3af0-4732-8ad7-1f7ec7678766 tempest-GroupSnapshotsV319Test-1529457669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-35d9919a-3af0-4732-8ad7-1f7ec7678766 tempest-GroupSnapshotsV319Test-1529457669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:55 devstack sudo[85909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:03:55 devstack sudo[85909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:56 devstack sudo[85905]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.be409673-e451-47b6-b378-9cb480c291af" returned: 0 in 0.545s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.be409673-e451-47b6-b378-9cb480c291af {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:56 devstack sudo[85913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.be409673-e451-47b6-b378-9cb480c291af Feb 27 02:03:56 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:56 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.be409673-e451-47b6-b378-9cb480c291af" returned: 0 in 0.628s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-quobyte-be409673-e451-47b6-b378-9cb480c291af" released by "_delete_snapshot" :: held 2.619s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-quobyte-3491ca09-8a98-47f6-ba60-9b22263748b8" released by "delete_snapshot" :: held 2.650s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:56 devstack sudo[85909]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:56 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] Created reservations ['64511855-21fe-4972-b6a4-ca2aa6dd8262', 'f5690b87-dbf7-4fda-9dfb-204c468241c0', '84b61ad2-7488-4c3e-b154-24e098a281fc', '4d85f5a1-4662-4bd5-8ed9-5048a2e53092'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-35d9919a-3af0-4732-8ad7-1f7ec7678766 tempest-GroupSnapshotsV319Test-1529457669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.896s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:56 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-35d9919a-3af0-4732-8ad7-1f7ec7678766 tempest-GroupSnapshotsV319Test-1529457669 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:56 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-35d9919a-3af0-4732-8ad7-1f7ec7678766 tempest-GroupSnapshotsV319Test-1529457669 None] Delete group completed successfully. Feb 27 02:03:56 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] Delete snapshot completed successfully. Feb 27 02:03:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3d601680-7e36-4ee5-a66d-d502340faa22 tempest-SnapshotsActionsTest-392702504 None] Lock "cinder-be409673-e451-47b6-b378-9cb480c291af-delete_snapshot" released by "delete_snapshot" :: held 2.774s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] Acquiring lock "cinder-492689e9-5259-444c-a864-4b1a74b6daa8-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] Lock "cinder-492689e9-5259-444c-a864-4b1a74b6daa8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] Acquiring lock "cinder-quobyte-3491ca09-8a98-47f6-ba60-9b22263748b8" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] Lock "cinder-quobyte-3491ca09-8a98-47f6-ba60-9b22263748b8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] Acquiring lock "cinder-quobyte-492689e9-5259-444c-a864-4b1a74b6daa8" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] Lock "cinder-quobyte-492689e9-5259-444c-a864-4b1a74b6daa8" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] Deleting offline snapshot 492689e9-5259-444c-a864-4b1a74b6daa8 of volume 3491ca09-8a98-47f6-ba60-9b22263748b8 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:03:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] snapshot_file for this snap is: volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:03:57 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1b2e8b-5515-4c9a-b7df-7999e2621d4f]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:57 devstack sudo[85918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 Feb 27 02:03:57 devstack sudo[85918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:58 devstack sudo[85918]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8" returned: 0 in 0.747s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3491ca09-8a98-47f6-ba60-9b22263748b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:58 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2aefaa-8dfd-4ebc-9e99-8201bb4a6054]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:58 devstack sudo[85929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8 Feb 27 02:03:58 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:59 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8" returned: 0 in 1.360s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:59 devstack sudo[85965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 Feb 27 02:03:59 devstack sudo[85965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Flow 'volume_create_manager' (07e7ac0c-0e77-441a-bd0b-58ce94d7822a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c31ea729-3827-4d88-89c3-7405281c3654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c31ea729-3827-4d88-89c3-7405281c3654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-766578326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f095dec9-0957-4984-9294-5c1d97e61a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a7074094e894bd1be5a85c2e460cd31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:00Z,use_quota=True,user_id='e11ad6d9e5b5492299310249730ecf98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79bb784a-51d7-4b5d-9e8a-c9ef50559825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79bb784a-51d7-4b5d-9e8a-c9ef50559825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab761f0c-6f4c-4a26-b5a7-178a26078842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab761f0c-6f4c-4a26-b5a7-178a26078842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f095dec9-0957-4984-9294-5c1d97e61a07', 'volume_name': 'volume-f095dec9-0957-4984-9294-5c1d97e61a07', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3064c0b5-9d7c-4a4a-a3be-6908a18054da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3064c0b5-9d7c-4a4a-a3be-6908a18054da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c42fef06-a839-4dfe-83aa-941c36c5dbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:00 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Volume f095dec9-0957-4984-9294-5c1d97e61a07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f095dec9-0957-4984-9294-5c1d97e61a07', 'volume_size': 1} Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-766578326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f095dec9-0957-4984-9294-5c1d97e61a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a7074094e894bd1be5a85c2e460cd31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:00Z,use_quota=True,user_id='e11ad6d9e5b5492299310249730ecf98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Creating volume f095dec9-0957-4984-9294-5c1d97e61a07 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:00 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:04:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f095dec9-0957-4984-9294-5c1d97e61a07 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:00 devstack sudo[85976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f095dec9-0957-4984-9294-5c1d97e61a07 1073741824 Feb 27 02:04:00 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:01 devstack sudo[85965]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8" returned: 0 in 1.218s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:01 devstack sudo[85983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8 Feb 27 02:04:01 devstack sudo[85983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:01 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f095dec9-0957-4984-9294-5c1d97e61a07 1073741824" returned: 0 in 1.146s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f095dec9-0957-4984-9294-5c1d97e61a07 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:01 devstack sudo[86003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f095dec9-0957-4984-9294-5c1d97e61a07 Feb 27 02:04:01 devstack sudo[86003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:01 devstack sudo[85983]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8.492689e9-5259-444c-a864-4b1a74b6daa8" returned: 0 in 0.915s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] Lock "cinder-quobyte-492689e9-5259-444c-a864-4b1a74b6daa8" released by "_delete_snapshot" :: held 4.396s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] Lock "cinder-quobyte-3491ca09-8a98-47f6-ba60-9b22263748b8" released by "delete_snapshot" :: held 4.414s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:02 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] Created reservations ['c99783b4-cd89-49ff-a8e6-d269a1749005', 'a5730a99-deab-4cb9-869f-f8d1238239a1', '4e72901f-aa92-407c-8752-8c98197f9533', '659f9ae1-f961-4de7-b5f2-44f8f03f7a3e'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:02 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] Delete snapshot completed successfully. Feb 27 02:04:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a794b6a0-03dc-4429-9892-42e9c557fec2 tempest-SnapshotsActionsTest-260193641 None] Lock "cinder-492689e9-5259-444c-a864-4b1a74b6daa8-delete_snapshot" released by "delete_snapshot" :: held 4.597s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:02 devstack sudo[86003]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f095dec9-0957-4984-9294-5c1d97e61a07" returned: 0 in 0.878s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c42fef06-a839-4dfe-83aa-941c36c5dbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f095dec9-0957-4984-9294-5c1d97e61a07', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78cd80ed-9c45-41cc-a8eb-3c5e1248dea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:02 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Volume volume-f095dec9-0957-4984-9294-5c1d97e61a07 (f095dec9-0957-4984-9294-5c1d97e61a07): created successfully Feb 27 02:04:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78cd80ed-9c45-41cc-a8eb-3c5e1248dea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Flow 'volume_create_manager' (07e7ac0c-0e77-441a-bd0b-58ce94d7822a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:02 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-0e0abe9a-fe50-4c67-ac97-46f3d05b50ae tempest-ServersNegativeTestJSON-726674030 None] Created volume successfully. Feb 27 02:04:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0185e9d9-4d6f-44fd-9837-ed3c9590f486 tempest-SnapshotsActionsTest-260193641 None] Acquiring lock "cinder-3491ca09-8a98-47f6-ba60-9b22263748b8-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0185e9d9-4d6f-44fd-9837-ed3c9590f486 tempest-SnapshotsActionsTest-260193641 None] Lock "cinder-3491ca09-8a98-47f6-ba60-9b22263748b8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0185e9d9-4d6f-44fd-9837-ed3c9590f486 tempest-SnapshotsActionsTest-260193641 None] Acquiring lock "cinder-quobyte-3491ca09-8a98-47f6-ba60-9b22263748b8" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0185e9d9-4d6f-44fd-9837-ed3c9590f486 tempest-SnapshotsActionsTest-260193641 None] Lock "cinder-quobyte-3491ca09-8a98-47f6-ba60-9b22263748b8" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:03 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d655daf7-5bbf-450e-b615-619e7fc00f1c]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0185e9d9-4d6f-44fd-9837-ed3c9590f486 tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:03 devstack sudo[86025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8 Feb 27 02:04:03 devstack sudo[86025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:03 devstack sudo[86025]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0185e9d9-4d6f-44fd-9837-ed3c9590f486 tempest-SnapshotsActionsTest-260193641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8" returned: 0 in 0.614s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0185e9d9-4d6f-44fd-9837-ed3c9590f486 tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:03 devstack sudo[86030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8 Feb 27 02:04:03 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:04 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0185e9d9-4d6f-44fd-9837-ed3c9590f486 tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3491ca09-8a98-47f6-ba60-9b22263748b8" returned: 0 in 0.676s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0185e9d9-4d6f-44fd-9837-ed3c9590f486 tempest-SnapshotsActionsTest-260193641 None] Lock "cinder-quobyte-3491ca09-8a98-47f6-ba60-9b22263748b8" released by "delete_volume" :: held 1.360s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:04 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-0185e9d9-4d6f-44fd-9837-ed3c9590f486 tempest-SnapshotsActionsTest-260193641 None] Created reservations ['5eb3fdb2-76c6-45d9-8e4b-e809baf90ac5', '0d021515-8e9c-43bd-aaac-69d0c8f1be96', '13cec3f8-73e9-434b-9572-dab56621d6de', 'c2e6b127-1ddd-450d-8627-7e82fe72bba1'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0185e9d9-4d6f-44fd-9837-ed3c9590f486 tempest-SnapshotsActionsTest-260193641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0185e9d9-4d6f-44fd-9837-ed3c9590f486 tempest-SnapshotsActionsTest-260193641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0185e9d9-4d6f-44fd-9837-ed3c9590f486 tempest-SnapshotsActionsTest-260193641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0185e9d9-4d6f-44fd-9837-ed3c9590f486 tempest-SnapshotsActionsTest-260193641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0185e9d9-4d6f-44fd-9837-ed3c9590f486 tempest-SnapshotsActionsTest-260193641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0185e9d9-4d6f-44fd-9837-ed3c9590f486 tempest-SnapshotsActionsTest-260193641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:04 devstack sudo[86034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:04:04 devstack sudo[86034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Flow 'volume_create_manager' (8c61dcdf-604e-44ca-9543-eed439431378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f4951c-621d-4510-a28a-7134d812e549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f4951c-621d-4510-a28a-7134d812e549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-957177170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d93031-5d85-4774-a2af-defa3593b048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a7074094e894bd1be5a85c2e460cd31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:05Z,use_quota=True,user_id='e11ad6d9e5b5492299310249730ecf98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9790c5ac-0861-48d9-bbb0-9b675053813e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9790c5ac-0861-48d9-bbb0-9b675053813e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99684417-dcb6-420d-89ff-dd25b740a98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99684417-dcb6-420d-89ff-dd25b740a98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d93031-5d85-4774-a2af-defa3593b048', 'volume_name': 'volume-05d93031-5d85-4774-a2af-defa3593b048', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9755be6b-cc63-4a28-8919-388b8316b2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9755be6b-cc63-4a28-8919-388b8316b2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e8bc5b-a8f2-4ada-a17f-76b7605f3c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:05 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Volume 05d93031-5d85-4774-a2af-defa3593b048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d93031-5d85-4774-a2af-defa3593b048', 'volume_size': 1} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-957177170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d93031-5d85-4774-a2af-defa3593b048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a7074094e894bd1be5a85c2e460cd31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:05Z,use_quota=True,user_id='e11ad6d9e5b5492299310249730ecf98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Creating volume 05d93031-5d85-4774-a2af-defa3593b048 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:05 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-05d93031-5d85-4774-a2af-defa3593b048 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:05 devstack sudo[86037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-05d93031-5d85-4774-a2af-defa3593b048 1073741824 Feb 27 02:04:05 devstack sudo[86037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:05 devstack sudo[86034]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0185e9d9-4d6f-44fd-9837-ed3c9590f486 tempest-SnapshotsActionsTest-260193641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.722s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-0185e9d9-4d6f-44fd-9837-ed3c9590f486 tempest-SnapshotsActionsTest-260193641 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:05 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-0185e9d9-4d6f-44fd-9837-ed3c9590f486 tempest-SnapshotsActionsTest-260193641 None] Deleted volume successfully. Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0185e9d9-4d6f-44fd-9837-ed3c9590f486 tempest-SnapshotsActionsTest-260193641 None] Lock "cinder-3491ca09-8a98-47f6-ba60-9b22263748b8-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:05 devstack sudo[86037]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-05d93031-5d85-4774-a2af-defa3593b048 1073741824" returned: 0 in 0.651s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-05d93031-5d85-4774-a2af-defa3593b048 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:05 devstack sudo[86042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-05d93031-5d85-4774-a2af-defa3593b048 Feb 27 02:04:05 devstack sudo[86042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:06 devstack sudo[86042]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-05d93031-5d85-4774-a2af-defa3593b048" returned: 0 in 0.833s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e8bc5b-a8f2-4ada-a17f-76b7605f3c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d93031-5d85-4774-a2af-defa3593b048', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1812c039-2e44-409f-8be9-a3e52507e125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:06 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Volume volume-05d93031-5d85-4774-a2af-defa3593b048 (05d93031-5d85-4774-a2af-defa3593b048): created successfully Feb 27 02:04:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1812c039-2e44-409f-8be9-a3e52507e125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Flow 'volume_create_manager' (8c61dcdf-604e-44ca-9543-eed439431378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:06 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ff60830c-e509-4cf3-a434-c94ee27af74f tempest-ServersNegativeTestJSON-726674030 None] Created volume successfully. Feb 27 02:04:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b0d3ced1-5a90-45c6-a0e7-0d0cfa761063 tempest-ServersNegativeTestJSON-726674030 None] Acquiring lock "cinder-05d93031-5d85-4774-a2af-defa3593b048-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b0d3ced1-5a90-45c6-a0e7-0d0cfa761063 tempest-ServersNegativeTestJSON-726674030 None] Lock "cinder-05d93031-5d85-4774-a2af-defa3593b048-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b0d3ced1-5a90-45c6-a0e7-0d0cfa761063 tempest-ServersNegativeTestJSON-726674030 None] Acquiring lock "cinder-quobyte-05d93031-5d85-4774-a2af-defa3593b048" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b0d3ced1-5a90-45c6-a0e7-0d0cfa761063 tempest-ServersNegativeTestJSON-726674030 None] Lock "cinder-quobyte-05d93031-5d85-4774-a2af-defa3593b048" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:08 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0da22dc-8de1-4d70-ae89-68bb422cd719]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b0d3ced1-5a90-45c6-a0e7-0d0cfa761063 tempest-ServersNegativeTestJSON-726674030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-05d93031-5d85-4774-a2af-defa3593b048 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:08 devstack sudo[86098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-05d93031-5d85-4774-a2af-defa3593b048 Feb 27 02:04:08 devstack sudo[86098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:09 devstack sudo[86098]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b0d3ced1-5a90-45c6-a0e7-0d0cfa761063 tempest-ServersNegativeTestJSON-726674030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-05d93031-5d85-4774-a2af-defa3593b048" returned: 0 in 1.063s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b0d3ced1-5a90-45c6-a0e7-0d0cfa761063 tempest-ServersNegativeTestJSON-726674030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-05d93031-5d85-4774-a2af-defa3593b048 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:09 devstack sudo[86103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-05d93031-5d85-4774-a2af-defa3593b048 Feb 27 02:04:09 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:10 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b0d3ced1-5a90-45c6-a0e7-0d0cfa761063 tempest-ServersNegativeTestJSON-726674030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-05d93031-5d85-4774-a2af-defa3593b048" returned: 0 in 0.950s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b0d3ced1-5a90-45c6-a0e7-0d0cfa761063 tempest-ServersNegativeTestJSON-726674030 None] Lock "cinder-quobyte-05d93031-5d85-4774-a2af-defa3593b048" released by "delete_volume" :: held 2.076s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:10 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-b0d3ced1-5a90-45c6-a0e7-0d0cfa761063 tempest-ServersNegativeTestJSON-726674030 None] Created reservations ['1ace7be7-d73c-429b-b754-79314edc89b7', '79277e38-d373-41e0-86aa-104d3c7828fd', '0fd5e972-2662-467f-ba15-7be8350587c0', '4892e850-f454-4532-b787-6191d4519c04'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b0d3ced1-5a90-45c6-a0e7-0d0cfa761063 tempest-ServersNegativeTestJSON-726674030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b0d3ced1-5a90-45c6-a0e7-0d0cfa761063 tempest-ServersNegativeTestJSON-726674030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b0d3ced1-5a90-45c6-a0e7-0d0cfa761063 tempest-ServersNegativeTestJSON-726674030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b0d3ced1-5a90-45c6-a0e7-0d0cfa761063 tempest-ServersNegativeTestJSON-726674030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b0d3ced1-5a90-45c6-a0e7-0d0cfa761063 tempest-ServersNegativeTestJSON-726674030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b0d3ced1-5a90-45c6-a0e7-0d0cfa761063 tempest-ServersNegativeTestJSON-726674030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:10 devstack sudo[86106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:04:10 devstack sudo[86106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81f5ac1f-8d7e-4172-9d33-b224ae1092ed tempest-ServersNegativeTestJSON-726674030 None] Acquiring lock "cinder-f095dec9-0957-4984-9294-5c1d97e61a07-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81f5ac1f-8d7e-4172-9d33-b224ae1092ed tempest-ServersNegativeTestJSON-726674030 None] Lock "cinder-f095dec9-0957-4984-9294-5c1d97e61a07-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81f5ac1f-8d7e-4172-9d33-b224ae1092ed tempest-ServersNegativeTestJSON-726674030 None] Acquiring lock "cinder-quobyte-f095dec9-0957-4984-9294-5c1d97e61a07" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81f5ac1f-8d7e-4172-9d33-b224ae1092ed tempest-ServersNegativeTestJSON-726674030 None] Lock "cinder-quobyte-f095dec9-0957-4984-9294-5c1d97e61a07" acquired by "delete_volume" :: waited 0.020s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:10 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b01985-0614-4f23-b1e4-118beaa57113]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81f5ac1f-8d7e-4172-9d33-b224ae1092ed tempest-ServersNegativeTestJSON-726674030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f095dec9-0957-4984-9294-5c1d97e61a07 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:11 devstack sudo[86108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f095dec9-0957-4984-9294-5c1d97e61a07 Feb 27 02:04:11 devstack sudo[86108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:11 devstack sudo[86106]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b0d3ced1-5a90-45c6-a0e7-0d0cfa761063 tempest-ServersNegativeTestJSON-726674030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.779s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:11 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-b0d3ced1-5a90-45c6-a0e7-0d0cfa761063 tempest-ServersNegativeTestJSON-726674030 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:11 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b0d3ced1-5a90-45c6-a0e7-0d0cfa761063 tempest-ServersNegativeTestJSON-726674030 None] Deleted volume successfully. Feb 27 02:04:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b0d3ced1-5a90-45c6-a0e7-0d0cfa761063 tempest-ServersNegativeTestJSON-726674030 None] Lock "cinder-05d93031-5d85-4774-a2af-defa3593b048-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:11 devstack sudo[86108]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81f5ac1f-8d7e-4172-9d33-b224ae1092ed tempest-ServersNegativeTestJSON-726674030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f095dec9-0957-4984-9294-5c1d97e61a07" returned: 0 in 0.954s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81f5ac1f-8d7e-4172-9d33-b224ae1092ed tempest-ServersNegativeTestJSON-726674030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f095dec9-0957-4984-9294-5c1d97e61a07 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:11 devstack sudo[86114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f095dec9-0957-4984-9294-5c1d97e61a07 Feb 27 02:04:11 devstack sudo[86114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:12 devstack sudo[86114]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81f5ac1f-8d7e-4172-9d33-b224ae1092ed tempest-ServersNegativeTestJSON-726674030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f095dec9-0957-4984-9294-5c1d97e61a07" returned: 0 in 0.912s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81f5ac1f-8d7e-4172-9d33-b224ae1092ed tempest-ServersNegativeTestJSON-726674030 None] Lock "cinder-quobyte-f095dec9-0957-4984-9294-5c1d97e61a07" released by "delete_volume" :: held 1.914s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:12 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-81f5ac1f-8d7e-4172-9d33-b224ae1092ed tempest-ServersNegativeTestJSON-726674030 None] Created reservations ['d700f5a5-a3c7-4631-b1b6-7aa45656b427', '3ec9553a-18a7-4e6a-a378-fc1aca6297ca', '77dbe2a8-fc44-4795-bd1b-666b7801611d', '3b926383-5b7c-42d3-93c4-d8bdbcc47900'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-81f5ac1f-8d7e-4172-9d33-b224ae1092ed tempest-ServersNegativeTestJSON-726674030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-81f5ac1f-8d7e-4172-9d33-b224ae1092ed tempest-ServersNegativeTestJSON-726674030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-81f5ac1f-8d7e-4172-9d33-b224ae1092ed tempest-ServersNegativeTestJSON-726674030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-81f5ac1f-8d7e-4172-9d33-b224ae1092ed tempest-ServersNegativeTestJSON-726674030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-81f5ac1f-8d7e-4172-9d33-b224ae1092ed tempest-ServersNegativeTestJSON-726674030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81f5ac1f-8d7e-4172-9d33-b224ae1092ed tempest-ServersNegativeTestJSON-726674030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:12 devstack sudo[86144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:04:12 devstack sudo[86144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:14 devstack sudo[86144]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81f5ac1f-8d7e-4172-9d33-b224ae1092ed tempest-ServersNegativeTestJSON-726674030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 1.081s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:14 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-81f5ac1f-8d7e-4172-9d33-b224ae1092ed tempest-ServersNegativeTestJSON-726674030 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:14 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-81f5ac1f-8d7e-4172-9d33-b224ae1092ed tempest-ServersNegativeTestJSON-726674030 None] Deleted volume successfully. Feb 27 02:04:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-81f5ac1f-8d7e-4172-9d33-b224ae1092ed tempest-ServersNegativeTestJSON-726674030 None] Lock "cinder-f095dec9-0957-4984-9294-5c1d97e61a07-delete_volume" released by "delete_volume" :: held 3.357s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Flow 'volume_create_manager' (940af4a9-cb2e-4fe9-adf4-2e0476566bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c1b914-f920-4db0-bbef-a6ab6e914476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c1b914-f920-4db0-bbef-a6ab6e914476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2120470762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c161ef3-5854-45ee-8783-c6772b55a7ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14fbece481074e148acfc75fca98a24d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:15Z,use_quota=True,user_id='4d04703ce4934851ab7316c92fcd1ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbcba378-3ece-4fef-ba00-9250099dc745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbcba378-3ece-4fef-ba00-9250099dc745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2015201-789d-4350-8eda-e2360ecf02e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2015201-789d-4350-8eda-e2360ecf02e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c161ef3-5854-45ee-8783-c6772b55a7ac', 'volume_name': 'volume-6c161ef3-5854-45ee-8783-c6772b55a7ac', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e78930-5e2e-4cec-8bfb-03a9914b9fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e78930-5e2e-4cec-8bfb-03a9914b9fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1fe6ca-a82b-4b25-b20b-e3b9d5b5ac33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:15 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Volume 6c161ef3-5854-45ee-8783-c6772b55a7ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c161ef3-5854-45ee-8783-c6772b55a7ac', 'volume_size': 1} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2120470762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c161ef3-5854-45ee-8783-c6772b55a7ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14fbece481074e148acfc75fca98a24d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:15Z,use_quota=True,user_id='4d04703ce4934851ab7316c92fcd1ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Creating volume 6c161ef3-5854-45ee-8783-c6772b55a7ac {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:15 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:04:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6c161ef3-5854-45ee-8783-c6772b55a7ac 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:15 devstack sudo[86190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6c161ef3-5854-45ee-8783-c6772b55a7ac 1073741824 Feb 27 02:04:15 devstack sudo[86190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:16 devstack sudo[86190]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6c161ef3-5854-45ee-8783-c6772b55a7ac 1073741824" returned: 0 in 0.835s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6c161ef3-5854-45ee-8783-c6772b55a7ac {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:16 devstack sudo[86199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6c161ef3-5854-45ee-8783-c6772b55a7ac Feb 27 02:04:16 devstack sudo[86199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:17 devstack sudo[86199]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6c161ef3-5854-45ee-8783-c6772b55a7ac" returned: 0 in 0.671s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1fe6ca-a82b-4b25-b20b-e3b9d5b5ac33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c161ef3-5854-45ee-8783-c6772b55a7ac', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93be6e9f-3142-403c-b177-5a2e5454eb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:17 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Volume volume-6c161ef3-5854-45ee-8783-c6772b55a7ac (6c161ef3-5854-45ee-8783-c6772b55a7ac): created successfully Feb 27 02:04:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93be6e9f-3142-403c-b177-5a2e5454eb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Flow 'volume_create_manager' (940af4a9-cb2e-4fe9-adf4-2e0476566bf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:17 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ccdfad30-7aca-484b-afd0-e04514809f13 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Created volume successfully. Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-882cdc4a-d278-42f3-9c2e-d999b2e37ac7 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Acquiring lock "cinder-6c161ef3-5854-45ee-8783-c6772b55a7ac-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-882cdc4a-d278-42f3-9c2e-d999b2e37ac7 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Lock "cinder-6c161ef3-5854-45ee-8783-c6772b55a7ac-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-882cdc4a-d278-42f3-9c2e-d999b2e37ac7 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Acquiring lock "cinder-quobyte-6c161ef3-5854-45ee-8783-c6772b55a7ac" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-882cdc4a-d278-42f3-9c2e-d999b2e37ac7 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Lock "cinder-quobyte-6c161ef3-5854-45ee-8783-c6772b55a7ac" acquired by "delete_volume" :: waited 0.021s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6751afa7-f309-4cdf-97e1-78b860c0894c]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-882cdc4a-d278-42f3-9c2e-d999b2e37ac7 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6c161ef3-5854-45ee-8783-c6772b55a7ac {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Flow 'volume_create_manager' (5fe2539f-4a77-49f1-8feb-de82482becc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c67b86f-e6b5-4503-bcc2-af00cd433335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c67b86f-e6b5-4503-bcc2-af00cd433335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-952407865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852ddc75-64e1-431a-8d4b-432588fb4da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c669b8df517045a3b50c39703066ea4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:18Z,use_quota=True,user_id='fbdc27c3706a418eaaae46a7cf234575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9ff6fb-7ce0-47bb-8f0e-af00d5487a13),volume_type_id=3b9ff6fb-7ce0-47bb-8f0e-af00d5487a13)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76fd74b9-97c4-4e1c-979f-48da75bcdb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76fd74b9-97c4-4e1c-979f-48da75bcdb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09928e99-5c1a-4dde-a018-ba47893d4126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09928e99-5c1a-4dde-a018-ba47893d4126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '852ddc75-64e1-431a-8d4b-432588fb4da9', 'volume_name': 'volume-852ddc75-64e1-431a-8d4b-432588fb4da9', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cee640-e376-468b-baa8-5b3a9d0b1633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cee640-e376-468b-baa8-5b3a9d0b1633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fff5051-d3aa-411c-9e94-a0cdb6eb2012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:18 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Volume 852ddc75-64e1-431a-8d4b-432588fb4da9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-852ddc75-64e1-431a-8d4b-432588fb4da9', 'volume_size': 1} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-952407865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852ddc75-64e1-431a-8d4b-432588fb4da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c669b8df517045a3b50c39703066ea4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:18Z,use_quota=True,user_id='fbdc27c3706a418eaaae46a7cf234575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b9ff6fb-7ce0-47bb-8f0e-af00d5487a13),volume_type_id=3b9ff6fb-7ce0-47bb-8f0e-af00d5487a13)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Creating volume 852ddc75-64e1-431a-8d4b-432588fb4da9 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:18 devstack sudo[86204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6c161ef3-5854-45ee-8783-c6772b55a7ac Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:18 devstack sudo[86204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:18 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-852ddc75-64e1-431a-8d4b-432588fb4da9 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:18 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-852ddc75-64e1-431a-8d4b-432588fb4da9 1073741824 Feb 27 02:04:18 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:18 devstack sudo[86204]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-882cdc4a-d278-42f3-9c2e-d999b2e37ac7 tempest-VolumeQuotasNegativeTestJSON-678776592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6c161ef3-5854-45ee-8783-c6772b55a7ac" returned: 0 in 0.550s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-882cdc4a-d278-42f3-9c2e-d999b2e37ac7 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6c161ef3-5854-45ee-8783-c6772b55a7ac {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:18 devstack sudo[86214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6c161ef3-5854-45ee-8783-c6772b55a7ac Feb 27 02:04:18 devstack sudo[86214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:19 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-852ddc75-64e1-431a-8d4b-432588fb4da9 1073741824" returned: 0 in 0.608s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-852ddc75-64e1-431a-8d4b-432588fb4da9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:19 devstack sudo[86216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-852ddc75-64e1-431a-8d4b-432588fb4da9 Feb 27 02:04:19 devstack sudo[86216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:19 devstack sudo[86214]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-882cdc4a-d278-42f3-9c2e-d999b2e37ac7 tempest-VolumeQuotasNegativeTestJSON-678776592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6c161ef3-5854-45ee-8783-c6772b55a7ac" returned: 0 in 0.518s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-882cdc4a-d278-42f3-9c2e-d999b2e37ac7 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Lock "cinder-quobyte-6c161ef3-5854-45ee-8783-c6772b55a7ac" released by "delete_volume" :: held 1.095s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:19 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-882cdc4a-d278-42f3-9c2e-d999b2e37ac7 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Created reservations ['a41dd3b1-e513-4fb7-89b3-6e8c7623c4d8', 'f6a40b76-2eab-44c4-9d3e-9c3957281ac9', 'b3108af4-24d0-4551-ab61-1289cf7dadf9', '075ec778-1632-45bd-95a2-050d95437ae2'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-882cdc4a-d278-42f3-9c2e-d999b2e37ac7 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-882cdc4a-d278-42f3-9c2e-d999b2e37ac7 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-882cdc4a-d278-42f3-9c2e-d999b2e37ac7 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-882cdc4a-d278-42f3-9c2e-d999b2e37ac7 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-882cdc4a-d278-42f3-9c2e-d999b2e37ac7 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-882cdc4a-d278-42f3-9c2e-d999b2e37ac7 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:19 devstack sudo[86220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:04:19 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:19 devstack sudo[86216]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-852ddc75-64e1-431a-8d4b-432588fb4da9" returned: 0 in 0.550s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fff5051-d3aa-411c-9e94-a0cdb6eb2012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-852ddc75-64e1-431a-8d4b-432588fb4da9', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2ebece-2919-445b-afcf-1cea0d39ce99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:19 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Volume volume-852ddc75-64e1-431a-8d4b-432588fb4da9 (852ddc75-64e1-431a-8d4b-432588fb4da9): created successfully Feb 27 02:04:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2ebece-2919-445b-afcf-1cea0d39ce99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Flow 'volume_create_manager' (5fe2539f-4a77-49f1-8feb-de82482becc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:19 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7d97fc2a-3179-4e85-beb5-957544913c60 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Created volume successfully. Feb 27 02:04:20 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-882cdc4a-d278-42f3-9c2e-d999b2e37ac7 tempest-VolumeQuotasNegativeTestJSON-678776592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.542s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:20 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-882cdc4a-d278-42f3-9c2e-d999b2e37ac7 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:20 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-882cdc4a-d278-42f3-9c2e-d999b2e37ac7 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Deleted volume successfully. Feb 27 02:04:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-882cdc4a-d278-42f3-9c2e-d999b2e37ac7 tempest-VolumeQuotasNegativeTestJSON-678776592 None] Lock "cinder-6c161ef3-5854-45ee-8783-c6772b55a7ac-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c1afc351-7d81-45c5-bbd2-5d63608c255c tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c1afc351-7d81-45c5-bbd2-5d63608c255c tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c1afc351-7d81-45c5-bbd2-5d63608c255c tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c1afc351-7d81-45c5-bbd2-5d63608c255c tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c1afc351-7d81-45c5-bbd2-5d63608c255c tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c1afc351-7d81-45c5-bbd2-5d63608c255c tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:20 devstack sudo[86223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:04:20 devstack sudo[86223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:21 devstack sudo[86223]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c1afc351-7d81-45c5-bbd2-5d63608c255c tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.662s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:21 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-c1afc351-7d81-45c5-bbd2-5d63608c255c tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:21 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c1afc351-7d81-45c5-bbd2-5d63608c255c tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Retype volume completed successfully. Feb 27 02:04:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Acquiring lock "cinder-852ddc75-64e1-431a-8d4b-432588fb4da9-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Lock "cinder-852ddc75-64e1-431a-8d4b-432588fb4da9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Acquiring lock "cinder-quobyte-852ddc75-64e1-431a-8d4b-432588fb4da9" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Lock "cinder-quobyte-852ddc75-64e1-431a-8d4b-432588fb4da9" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:22 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f81637d-8094-4985-b85e-9567cdeefa6f]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-852ddc75-64e1-431a-8d4b-432588fb4da9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:22 devstack sudo[86226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-852ddc75-64e1-431a-8d4b-432588fb4da9 Feb 27 02:04:22 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:22 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-852ddc75-64e1-431a-8d4b-432588fb4da9" returned: 0 in 0.748s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-852ddc75-64e1-431a-8d4b-432588fb4da9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:22 devstack sudo[86232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-852ddc75-64e1-431a-8d4b-432588fb4da9 Feb 27 02:04:22 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:23 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-852ddc75-64e1-431a-8d4b-432588fb4da9" returned: 0 in 0.620s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Lock "cinder-quobyte-852ddc75-64e1-431a-8d4b-432588fb4da9" released by "delete_volume" :: held 1.409s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:23 devstack cinder-volume[83167]: WARNING cinder.quota [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:04:23 devstack cinder-volume[83167]: WARNING cinder.quota [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:04:23 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Created reservations ['5854a72b-d8db-4548-aeb0-dec1f90dbd3c', '0c5647ca-9d30-4196-8881-27c4060416ec', 'a8403b08-62b7-4f0c-8445-1afb605883fb', 'b55de81a-532a-434e-bdb8-1e0705ec1cda'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:23 devstack sudo[86250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:04:23 devstack sudo[86250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:24 devstack sudo[86250]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.625s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:24 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:24 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Deleted volume successfully. Feb 27 02:04:24 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b2835c80-314c-430c-be81-0573ebc807b7 tempest-VolumeRetypeWithoutMigrationTest-1800010313 None] Lock "cinder-852ddc75-64e1-431a-8d4b-432588fb4da9-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Flow 'volume_create_manager' (1bff57b7-e5a2-4d94-93a3-eb3ab4ff90a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2985d219-f080-49f1-860e-5182957661dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2985d219-f080-49f1-860e-5182957661dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-824088010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33cb19f6-50f3-4b85-add0-8faa17b9c0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5eb12787c574040a542ae5eff535214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:30Z,use_quota=True,user_id='642ca069a2c84ed09556f9ee8d952d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7498fbef-2d69-46e3-94ad-be8f695dd21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7498fbef-2d69-46e3-94ad-be8f695dd21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caa248bc-64a4-4905-87e0-d4f4bb6bc57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caa248bc-64a4-4905-87e0-d4f4bb6bc57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33cb19f6-50f3-4b85-add0-8faa17b9c0bf', 'volume_name': 'volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e837fc-676b-4e28-a207-d3ea2923acbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e837fc-676b-4e28-a207-d3ea2923acbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a690d1ef-d6fb-457f-8628-362f2f2a7748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:30 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Volume 33cb19f6-50f3-4b85-add0-8faa17b9c0bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf', 'volume_size': 1} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-824088010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33cb19f6-50f3-4b85-add0-8faa17b9c0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5eb12787c574040a542ae5eff535214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:30Z,use_quota=True,user_id='642ca069a2c84ed09556f9ee8d952d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Creating volume 33cb19f6-50f3-4b85-add0-8faa17b9c0bf {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:30 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:30 devstack sudo[86286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf 1073741824 Feb 27 02:04:30 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:30 devstack sudo[86288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:04:30 devstack sudo[86288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:31 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf 1073741824" returned: 0 in 0.986s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:31 devstack sudo[86294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf Feb 27 02:04:31 devstack sudo[86294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:31 devstack sudo[86288]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.793s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:31 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:32 devstack sudo[86294]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf" returned: 0 in 0.723s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a690d1ef-d6fb-457f-8628-362f2f2a7748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd6fbf3-d539-4112-9580-55b077a27836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:32 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Volume volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf (33cb19f6-50f3-4b85-add0-8faa17b9c0bf): created successfully Feb 27 02:04:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd6fbf3-d539-4112-9580-55b077a27836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Flow 'volume_create_manager' (1bff57b7-e5a2-4d94-93a3-eb3ab4ff90a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:32 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-76454e47-68c2-42ff-8c8e-104b356106e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Created volume successfully. Feb 27 02:04:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0e745c8f-9b7e-4487-812e-c48df1baf9dc tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0e745c8f-9b7e-4487-812e-c48df1baf9dc tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-0e745c8f-9b7e-4487-812e-c48df1baf9dc tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Creating offline snapshot d4823633-e9ee-4f7f-8606-a59748a65df9 of volume 33cb19f6-50f3-4b85-add0-8faa17b9c0bf {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:04:32 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06931e5-cea0-4b01-b347-6a8c9bcde8fa]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0e745c8f-9b7e-4487-812e-c48df1baf9dc tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:33 devstack sudo[86297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf Feb 27 02:04:33 devstack sudo[86297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:33 devstack sudo[86297]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0e745c8f-9b7e-4487-812e-c48df1baf9dc tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf" returned: 0 in 0.638s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0e745c8f-9b7e-4487-812e-c48df1baf9dc tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.d4823633-e9ee-4f7f-8606-a59748a65df9 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:33 devstack sudo[86302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.d4823633-e9ee-4f7f-8606-a59748a65df9 1G Feb 27 02:04:33 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:34 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0e745c8f-9b7e-4487-812e-c48df1baf9dc tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.d4823633-e9ee-4f7f-8606-a59748a65df9 1G" returned: 0 in 0.881s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0e745c8f-9b7e-4487-812e-c48df1baf9dc tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.d4823633-e9ee-4f7f-8606-a59748a65df9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:34 devstack sudo[86345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.d4823633-e9ee-4f7f-8606-a59748a65df9 Feb 27 02:04:34 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:35 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0e745c8f-9b7e-4487-812e-c48df1baf9dc tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.d4823633-e9ee-4f7f-8606-a59748a65df9" returned: 0 in 0.581s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:35 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-0e745c8f-9b7e-4487-812e-c48df1baf9dc tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.d4823633-e9ee-4f7f-8606-a59748a65df9 is being set with open permissions: ugo+rw Feb 27 02:04:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0e745c8f-9b7e-4487-812e-c48df1baf9dc tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.d4823633-e9ee-4f7f-8606-a59748a65df9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:35 devstack sudo[86352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.d4823633-e9ee-4f7f-8606-a59748a65df9 Feb 27 02:04:35 devstack sudo[86352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:35 devstack sudo[86352]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0e745c8f-9b7e-4487-812e-c48df1baf9dc tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.d4823633-e9ee-4f7f-8606-a59748a65df9" returned: 0 in 0.499s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0e745c8f-9b7e-4487-812e-c48df1baf9dc tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:35 devstack sudo[86355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.info Feb 27 02:04:35 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:36 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0e745c8f-9b7e-4487-812e-c48df1baf9dc tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.info" returned: 0 in 0.509s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:36 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-0e745c8f-9b7e-4487-812e-c48df1baf9dc tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.info is being set with open permissions: ugo+rw Feb 27 02:04:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0e745c8f-9b7e-4487-812e-c48df1baf9dc tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:36 devstack sudo[86358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.info Feb 27 02:04:36 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:36 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Flow 'volume_create_manager' (da4a66a0-42e3-4c88-872a-c3532548ff1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c05c0c-47c3-4646-a1ae-8d70799abad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:36 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0e745c8f-9b7e-4487-812e-c48df1baf9dc tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.info" returned: 0 in 0.585s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0e745c8f-9b7e-4487-812e-c48df1baf9dc tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.796s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c05c0c-47c3-4646-a1ae-8d70799abad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1847762957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040708abd0c447498230b1a268583be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:37Z,use_quota=True,user_id='84686494bd5d47d6bf96b208f80130bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa139f65-2a54-405a-a8bb-af454b50dcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa139f65-2a54-405a-a8bb-af454b50dcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5bf4d2e-5a70-420b-a522-ab2b50df7a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:36 devstack cinder-volume[83167]: DEBUG cinder.image.glance [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Creating Keystone auth plugin from conf {{(pid=83167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 02:04:36 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-0e745c8f-9b7e-4487-812e-c48df1baf9dc tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Create snapshot completed successfully Feb 27 02:04:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5bf4d2e-5a70-420b-a522-ab2b50df7a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8', 'volume_name': 'volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8', 'volume_size': 1, 'image_id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c3ebea7eea44d62b013a3b663b3a45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74e16fab-69df-4cb3-99da-0b06bc338767/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8441f4b3-0974-4d1b-b79b-3b85c3d4db87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8441f4b3-0974-4d1b-b79b-3b85c3d4db87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ebb270-7701-4e9e-a13d-155c5ab64cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:37 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Volume af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8', 'volume_size': 1, 'image_id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c3ebea7eea44d62b013a3b663b3a45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74e16fab-69df-4cb3-99da-0b06bc338767/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 02:04:37 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Trying to clone af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 from image 74e16fab-69df-4cb3-99da-0b06bc338767 at location (None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}]). {{(pid=83167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 02:04:37 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_jmf7ng_6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 02:04:37 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Image download 20.69 MB at 20.69 MB/s Feb 27 02:04:37 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e4a21f-7237-497c-9d6d-961d615d1833]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_jmf7ng_6devstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:37 devstack sudo[86406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_jmf7ng_6devstack@QuobyteHD Feb 27 02:04:37 devstack sudo[86406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Acquiring lock "cinder-d4823633-e9ee-4f7f-8606-a59748a65df9-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Lock "cinder-d4823633-e9ee-4f7f-8606-a59748a65df9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Acquiring lock "cinder-quobyte-33cb19f6-50f3-4b85-add0-8faa17b9c0bf" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Lock "cinder-quobyte-33cb19f6-50f3-4b85-add0-8faa17b9c0bf" acquired by "delete_snapshot" :: waited 0.045s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Acquiring lock "cinder-quobyte-d4823633-e9ee-4f7f-8606-a59748a65df9" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Lock "cinder-quobyte-d4823633-e9ee-4f7f-8606-a59748a65df9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Deleting offline snapshot d4823633-e9ee-4f7f-8606-a59748a65df9 of volume 33cb19f6-50f3-4b85-add0-8faa17b9c0bf {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:04:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] snapshot_file for this snap is: volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.d4823633-e9ee-4f7f-8606-a59748a65df9 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:04:37 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[adce3e94-db07-4c95-83ae-9e098e939d85]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.d4823633-e9ee-4f7f-8606-a59748a65df9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:37 devstack sudo[86408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.d4823633-e9ee-4f7f-8606-a59748a65df9 Feb 27 02:04:38 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:38 devstack sudo[86406]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_jmf7ng_6devstack@QuobyteHD" returned: 0 in 0.883s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:38 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Temporary image 74e16fab-69df-4cb3-99da-0b06bc338767 is fetched for user 84686494bd5d47d6bf96b208f80130bf. {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 02:04:38 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd58f6c6-ff34-4669-8127-d342a9ae5bec]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_jmf7ng_6devstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:38 devstack sudo[86413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_jmf7ng_6devstack@QuobyteHD Feb 27 02:04:38 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:38 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.d4823633-e9ee-4f7f-8606-a59748a65df9" returned: 0 in 0.981s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:38 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[229f7264-6400-41c6-be72-2e3e50c953d9]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:39 devstack sudo[86418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf Feb 27 02:04:39 devstack sudo[86418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:39 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_jmf7ng_6devstack@QuobyteHD" returned: 0 in 0.867s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1847762957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040708abd0c447498230b1a268583be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:37Z,use_quota=True,user_id='84686494bd5d47d6bf96b208f80130bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Creating volume af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:39 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:04:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:39 devstack sudo[86423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 1073741824 Feb 27 02:04:39 devstack sudo[86423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:39 devstack sudo[86418]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf" returned: 0 in 0.727s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.d4823633-e9ee-4f7f-8606-a59748a65df9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:39 devstack sudo[86428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.d4823633-e9ee-4f7f-8606-a59748a65df9 Feb 27 02:04:39 devstack sudo[86428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:40 devstack sudo[86423]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 1073741824" returned: 0 in 0.894s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:40 devstack sudo[86436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 Feb 27 02:04:40 devstack sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:40 devstack sudo[86428]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.d4823633-e9ee-4f7f-8606-a59748a65df9" returned: 0 in 0.916s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.d4823633-e9ee-4f7f-8606-a59748a65df9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:40 devstack sudo[86438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.d4823633-e9ee-4f7f-8606-a59748a65df9 Feb 27 02:04:40 devstack sudo[86438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:40 devstack sudo[86436]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8" returned: 0 in 0.575s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:40 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Attempting download of 74e16fab-69df-4cb3-99da-0b06bc338767 ((None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}])) to volume af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8. {{(pid=83167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 02:04:41 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[93943d27-f702-4d10-9b93-959eb55b0ffc]: (4, 'raw') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_8n45saba {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:41 devstack sudo[86438]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf.d4823633-e9ee-4f7f-8606-a59748a65df9" returned: 0 in 0.607s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:41 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Lock "cinder-quobyte-d4823633-e9ee-4f7f-8606-a59748a65df9" released by "_delete_snapshot" :: held 3.391s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:41 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Lock "cinder-quobyte-33cb19f6-50f3-4b85-add0-8faa17b9c0bf" released by "delete_snapshot" :: held 3.417s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:41 devstack sudo[86442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_8n45saba Feb 27 02:04:41 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:41 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Created reservations ['97480696-dd65-445a-8ec1-56fb91dd5687', '120f858e-a6ef-445a-a103-e51135a2c5ec', 'eb68c901-c52e-4ebc-b142-c9f21d5172bc', 'c9f1f4bc-8506-4dab-a450-97638d38a6c7'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:41 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Delete snapshot completed successfully. Feb 27 02:04:41 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bc0af763-7a4d-447a-a977-7a8e646de5f3 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Lock "cinder-d4823633-e9ee-4f7f-8606-a59748a65df9-delete_snapshot" released by "delete_snapshot" :: held 3.606s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:41 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_8n45saba" returned: 0 in 0.872s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_8n45saba {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:42 devstack sudo[86466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_8n45saba Feb 27 02:04:42 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6cd2c222-461e-4a5d-9b4b-f3b3d74bac13 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Acquiring lock "cinder-33cb19f6-50f3-4b85-add0-8faa17b9c0bf-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6cd2c222-461e-4a5d-9b4b-f3b3d74bac13 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Lock "cinder-33cb19f6-50f3-4b85-add0-8faa17b9c0bf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6cd2c222-461e-4a5d-9b4b-f3b3d74bac13 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Acquiring lock "cinder-quobyte-33cb19f6-50f3-4b85-add0-8faa17b9c0bf" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6cd2c222-461e-4a5d-9b4b-f3b3d74bac13 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Lock "cinder-quobyte-33cb19f6-50f3-4b85-add0-8faa17b9c0bf" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd319510-4355-4525-b665-d331c0f18998]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6cd2c222-461e-4a5d-9b4b-f3b3d74bac13 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:42 devstack sudo[86468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf Feb 27 02:04:42 devstack sudo[86468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:42 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_8n45saba" returned: 1 in 0.607s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_8n45saba' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c7c862-926d-43cd-a652-7f2949ebbb2c]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_jmf7ng_6devstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:42 devstack sudo[86472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_jmf7ng_6devstack@QuobyteHD Feb 27 02:04:42 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Flow 'volume_create_manager' (21f43600-d66f-4086-af6a-c5a7c0cb082d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55890bb-c347-447a-8fcf-0165bd0b17ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55890bb-c347-447a-8fcf-0165bd0b17ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1298144221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b58ff43-2dfc-4363-b108-e602cdd2b1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fd794b161646efa2848c094ed017ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:43Z,use_quota=True,user_id='a8197672c4a44646ba0c422d63b74492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9afef1f7-f7f3-4050-aae7-b142cab8722a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9afef1f7-f7f3-4050-aae7-b142cab8722a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25571582-00a4-4328-94a6-7022909fdafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25571582-00a4-4328-94a6-7022909fdafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b58ff43-2dfc-4363-b108-e602cdd2b1cc', 'volume_name': 'volume-6b58ff43-2dfc-4363-b108-e602cdd2b1cc', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f007a9-e7f5-486b-b5a4-b29dba342516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f007a9-e7f5-486b-b5a4-b29dba342516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b2ac22-ae6a-4a0c-81ea-649c407192ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:42 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Volume 6b58ff43-2dfc-4363-b108-e602cdd2b1cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b58ff43-2dfc-4363-b108-e602cdd2b1cc', 'volume_size': 1} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1298144221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b58ff43-2dfc-4363-b108-e602cdd2b1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fd794b161646efa2848c094ed017ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:43Z,use_quota=True,user_id='a8197672c4a44646ba0c422d63b74492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Creating volume 6b58ff43-2dfc-4363-b108-e602cdd2b1cc {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:42 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b58ff43-2dfc-4363-b108-e602cdd2b1cc 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:42 devstack sudo[86468]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6cd2c222-461e-4a5d-9b4b-f3b3d74bac13 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf" returned: 0 in 0.652s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6cd2c222-461e-4a5d-9b4b-f3b3d74bac13 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:42 devstack sudo[86477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b58ff43-2dfc-4363-b108-e602cdd2b1cc 1073741824 Feb 27 02:04:42 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:42 devstack sudo[86478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf Feb 27 02:04:42 devstack sudo[86478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:43 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_jmf7ng_6devstack@QuobyteHD" returned: 0 in 0.618s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:43 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] 74e16fab-69df-4cb3-99da-0b06bc338767 was qcow2, converting to raw {{(pid=83167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 02:04:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_jmf7ng_6devstack@QuobyteHD /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:43 devstack sudo[86484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_jmf7ng_6devstack@QuobyteHD /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 Feb 27 02:04:43 devstack sudo[86484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:43 devstack sudo[86478]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6cd2c222-461e-4a5d-9b4b-f3b3d74bac13 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-33cb19f6-50f3-4b85-add0-8faa17b9c0bf" returned: 0 in 0.547s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6cd2c222-461e-4a5d-9b4b-f3b3d74bac13 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Lock "cinder-quobyte-33cb19f6-50f3-4b85-add0-8faa17b9c0bf" released by "delete_volume" :: held 1.245s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:43 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-6cd2c222-461e-4a5d-9b4b-f3b3d74bac13 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Created reservations ['7e5f2fb8-889a-4539-9b27-9b82482a65d7', '7dad7848-277d-4935-aab0-630a21d2c388', '5265dfbe-6702-4362-b32a-a89af2c8f250', 'a4ade175-40a2-4fd8-b069-008be785c9b0'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6cd2c222-461e-4a5d-9b4b-f3b3d74bac13 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6cd2c222-461e-4a5d-9b4b-f3b3d74bac13 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6cd2c222-461e-4a5d-9b4b-f3b3d74bac13 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6cd2c222-461e-4a5d-9b4b-f3b3d74bac13 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6cd2c222-461e-4a5d-9b4b-f3b3d74bac13 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6cd2c222-461e-4a5d-9b4b-f3b3d74bac13 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:43 devstack sudo[86490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:04:43 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:43 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b58ff43-2dfc-4363-b108-e602cdd2b1cc 1073741824" returned: 0 in 0.816s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b58ff43-2dfc-4363-b108-e602cdd2b1cc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:43 devstack sudo[86495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b58ff43-2dfc-4363-b108-e602cdd2b1cc Feb 27 02:04:43 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:44 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6cd2c222-461e-4a5d-9b4b-f3b3d74bac13 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.539s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:44 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-6cd2c222-461e-4a5d-9b4b-f3b3d74bac13 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:44 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-6cd2c222-461e-4a5d-9b4b-f3b3d74bac13 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Deleted volume successfully. Feb 27 02:04:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6cd2c222-461e-4a5d-9b4b-f3b3d74bac13 tempest-VolumeSnapshotQuotasNegativeTestJSON-100547150 None] Lock "cinder-33cb19f6-50f3-4b85-add0-8faa17b9c0bf-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:44 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b58ff43-2dfc-4363-b108-e602cdd2b1cc" returned: 0 in 0.587s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b2ac22-ae6a-4a0c-81ea-649c407192ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b58ff43-2dfc-4363-b108-e602cdd2b1cc', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba234c9-880c-4118-820b-d69172318801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:44 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Volume volume-6b58ff43-2dfc-4363-b108-e602cdd2b1cc (6b58ff43-2dfc-4363-b108-e602cdd2b1cc): created successfully Feb 27 02:04:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba234c9-880c-4118-820b-d69172318801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Flow 'volume_create_manager' (21f43600-d66f-4086-af6a-c5a7c0cb082d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:44 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-20225dfb-af0f-4982-8a01-9a1f0f05b5ff tempest-VolumeQuotasAdminTestJSON-115296742 None] Created volume successfully. Feb 27 02:04:44 devstack sudo[86484]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_jmf7ng_6devstack@QuobyteHD /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8" returned: 0 in 1.340s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:44 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_jmf7ng_6devstack@QuobyteHD, size 112.00 MB, duration 1.34 sec, destination /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:04:44 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Converted 112.00 MB image at 83.54 MB/s Feb 27 02:04:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:44 devstack sudo[86502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 1G Feb 27 02:04:44 devstack sudo[86502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0c323a6b-33dd-48d7-9ed5-fad557b9b145 tempest-VolumeQuotasAdminTestJSON-115296742 None] Acquiring lock "cinder-6b58ff43-2dfc-4363-b108-e602cdd2b1cc-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0c323a6b-33dd-48d7-9ed5-fad557b9b145 tempest-VolumeQuotasAdminTestJSON-115296742 None] Lock "cinder-6b58ff43-2dfc-4363-b108-e602cdd2b1cc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0c323a6b-33dd-48d7-9ed5-fad557b9b145 tempest-VolumeQuotasAdminTestJSON-115296742 None] Acquiring lock "cinder-quobyte-6b58ff43-2dfc-4363-b108-e602cdd2b1cc" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0c323a6b-33dd-48d7-9ed5-fad557b9b145 tempest-VolumeQuotasAdminTestJSON-115296742 None] Lock "cinder-quobyte-6b58ff43-2dfc-4363-b108-e602cdd2b1cc" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:44 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9230673-fd03-4df5-b7e1-aa522eada413]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0c323a6b-33dd-48d7-9ed5-fad557b9b145 tempest-VolumeQuotasAdminTestJSON-115296742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b58ff43-2dfc-4363-b108-e602cdd2b1cc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:45 devstack sudo[86506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b58ff43-2dfc-4363-b108-e602cdd2b1cc Feb 27 02:04:45 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:45 devstack sudo[86502]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 1G" returned: 0 in 0.733s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:45 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[065d4957-5cd5-4d65-90b8-8f03e99529fc]: (4, 'raw') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:45 devstack sudo[86509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 Feb 27 02:04:45 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:45 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0c323a6b-33dd-48d7-9ed5-fad557b9b145 tempest-VolumeQuotasAdminTestJSON-115296742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b58ff43-2dfc-4363-b108-e602cdd2b1cc" returned: 0 in 0.737s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0c323a6b-33dd-48d7-9ed5-fad557b9b145 tempest-VolumeQuotasAdminTestJSON-115296742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b58ff43-2dfc-4363-b108-e602cdd2b1cc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:45 devstack sudo[86514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b58ff43-2dfc-4363-b108-e602cdd2b1cc Feb 27 02:04:45 devstack sudo[86514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:46 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8" returned: 0 in 0.780s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:46 devstack sudo[86518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 Feb 27 02:04:46 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:46 devstack sudo[86514]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0c323a6b-33dd-48d7-9ed5-fad557b9b145 tempest-VolumeQuotasAdminTestJSON-115296742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b58ff43-2dfc-4363-b108-e602cdd2b1cc" returned: 0 in 0.804s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0c323a6b-33dd-48d7-9ed5-fad557b9b145 tempest-VolumeQuotasAdminTestJSON-115296742 None] Lock "cinder-quobyte-6b58ff43-2dfc-4363-b108-e602cdd2b1cc" released by "delete_volume" :: held 1.581s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:46 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-0c323a6b-33dd-48d7-9ed5-fad557b9b145 tempest-VolumeQuotasAdminTestJSON-115296742 None] Created reservations ['9fab367e-b4db-49f1-80e1-2f7655ab777c', 'a50af1dc-7f71-492c-a394-ba68342d9fca', 'ea819730-b368-4458-95a6-1209f61b57dd', '6518e1ac-f2c6-4928-a24f-110074126f5d'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0c323a6b-33dd-48d7-9ed5-fad557b9b145 tempest-VolumeQuotasAdminTestJSON-115296742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0c323a6b-33dd-48d7-9ed5-fad557b9b145 tempest-VolumeQuotasAdminTestJSON-115296742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0c323a6b-33dd-48d7-9ed5-fad557b9b145 tempest-VolumeQuotasAdminTestJSON-115296742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0c323a6b-33dd-48d7-9ed5-fad557b9b145 tempest-VolumeQuotasAdminTestJSON-115296742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0c323a6b-33dd-48d7-9ed5-fad557b9b145 tempest-VolumeQuotasAdminTestJSON-115296742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0c323a6b-33dd-48d7-9ed5-fad557b9b145 tempest-VolumeQuotasAdminTestJSON-115296742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:46 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:04:46 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:47 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0c323a6b-33dd-48d7-9ed5-fad557b9b145 tempest-VolumeQuotasAdminTestJSON-115296742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.910s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:47 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-0c323a6b-33dd-48d7-9ed5-fad557b9b145 tempest-VolumeQuotasAdminTestJSON-115296742 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:47 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-0c323a6b-33dd-48d7-9ed5-fad557b9b145 tempest-VolumeQuotasAdminTestJSON-115296742 None] Deleted volume successfully. Feb 27 02:04:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0c323a6b-33dd-48d7-9ed5-fad557b9b145 tempest-VolumeQuotasAdminTestJSON-115296742 None] Lock "cinder-6b58ff43-2dfc-4363-b108-e602cdd2b1cc-delete_volume" released by "delete_volume" :: held 2.711s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:47 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8" returned: 1 in 1.537s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:04:47 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Downloaded image 74e16fab-69df-4cb3-99da-0b06bc338767 ((None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}])) to volume af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 successfully. {{(pid=83167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 02:04:47 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Temporary image 74e16fab-69df-4cb3-99da-0b06bc338767 for user 84686494bd5d47d6bf96b208f80130bf is deleted. {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 02:04:47 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Marking volume af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 as bootable. {{(pid=83167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 02:04:47 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Copying metadata from image 74e16fab-69df-4cb3-99da-0b06bc338767 to af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8. {{(pid=83167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 02:04:47 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Creating volume glance metadata for volume af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 backed by image 74e16fab-69df-4cb3-99da-0b06bc338767 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 02:04:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ebb270-7701-4e9e-a13d-155c5ab64cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8', 'volume_size': 1, 'image_id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c3ebea7eea44d62b013a3b663b3a45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74e16fab-69df-4cb3-99da-0b06bc338767/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e976e4a4-c497-4e24-9263-499b81c80a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:47 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Volume volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 (af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8): created successfully Feb 27 02:04:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e976e4a4-c497-4e24-9263-499b81c80a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Flow 'volume_create_manager' (da4a66a0-42e3-4c88-872a-c3532548ff1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:47 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-013c7bba-bc7a-4b73-8fe7-73c39b22a268 tempest-VolumesImageMetadata-1081926020 None] Created volume successfully. Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Flow 'volume_create_manager' (29336917-1252-4129-ba99-a30b9c8c5c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf864ff1-fa31-475a-8ffd-633a94e780b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf864ff1-fa31-475a-8ffd-633a94e780b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-210743072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f7c6f40-5408-4991-9db3-6143d793ef71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fd794b161646efa2848c094ed017ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:48Z,use_quota=True,user_id='a8197672c4a44646ba0c422d63b74492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff397906-b9a8-422c-b773-e01c810ef112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff397906-b9a8-422c-b773-e01c810ef112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (308bc8e2-1c3c-4c12-9139-e3ed9e49fe22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (308bc8e2-1c3c-4c12-9139-e3ed9e49fe22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f7c6f40-5408-4991-9db3-6143d793ef71', 'volume_name': 'volume-4f7c6f40-5408-4991-9db3-6143d793ef71', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e658ad50-99ad-429e-a6d8-3308e1f399b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e658ad50-99ad-429e-a6d8-3308e1f399b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e7f8c6-ab52-4822-8ba1-fe74f03d3645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:48 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Volume 4f7c6f40-5408-4991-9db3-6143d793ef71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f7c6f40-5408-4991-9db3-6143d793ef71', 'volume_size': 1} Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-210743072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f7c6f40-5408-4991-9db3-6143d793ef71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fd794b161646efa2848c094ed017ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:48Z,use_quota=True,user_id='a8197672c4a44646ba0c422d63b74492',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Creating volume 4f7c6f40-5408-4991-9db3-6143d793ef71 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:48 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:04:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4f7c6f40-5408-4991-9db3-6143d793ef71 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:48 devstack sudo[86528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4f7c6f40-5408-4991-9db3-6143d793ef71 1073741824 Feb 27 02:04:48 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Flow 'volume_create_manager' (117a7901-c4d1-48b1-9c3d-386998936c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3687f3e-7bf9-40a2-b1c8-d4db1cebf273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3687f3e-7bf9-40a2-b1c8-d4db1cebf273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:49Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97fe86c9-8d57-402f-8a62-9ad5a7cbf469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc3912d24584369bb34ad374b7dd153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:49Z,use_quota=True,user_id='dfe3dd27c4734936979324d5de2400aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84781334-4666-4bcb-94c0-444843d8d37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84781334-4666-4bcb-94c0-444843d8d37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5115b004-1756-4628-94c3-df7c6ece00bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG cinder.image.glance [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Creating Keystone auth plugin from conf {{(pid=83167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] Acquiring lock "cinder-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] Lock "cinder-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=101,cinder:INSERT=31,cinder:UPDATE=119,cinder:DELETE=7 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:UPDATE=124,cinder:SELECT=109,cinder:DELETE=9,cinder:INSERT=39 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5115b004-1756-4628-94c3-df7c6ece00bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '97fe86c9-8d57-402f-8a62-9ad5a7cbf469', 'volume_name': 'volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469', 'volume_size': 1, 'image_id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c3ebea7eea44d62b013a3b663b3a45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74e16fab-69df-4cb3-99da-0b06bc338767/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de77fd43-c130-48bd-87c9-97a09dd783ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de77fd43-c130-48bd-87c9-97a09dd783ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (049b584e-f431-44ea-8300-1343bbed0b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:49 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Volume 97fe86c9-8d57-402f-8a62-9ad5a7cbf469: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469', 'volume_size': 1, 'image_id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c3ebea7eea44d62b013a3b663b3a45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74e16fab-69df-4cb3-99da-0b06bc338767/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Trying to clone 97fe86c9-8d57-402f-8a62-9ad5a7cbf469 from image 74e16fab-69df-4cb3-99da-0b06bc338767 at location (None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}]). {{(pid=83167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] Acquiring lock "cinder-quobyte-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] Lock "cinder-quobyte-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a395ce-6025-4f33-ae53-3cff3a70c094]: (4, 'raw') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:49 devstack sudo[86535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 Feb 27 02:04:49 devstack sudo[86535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:50 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4f7c6f40-5408-4991-9db3-6143d793ef71 1073741824" returned: 0 in 1.920s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4f7c6f40-5408-4991-9db3-6143d793ef71 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:50 devstack sudo[86538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4f7c6f40-5408-4991-9db3-6143d793ef71 Feb 27 02:04:50 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:50 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_be6qi5acdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 02:04:50 devstack cinder-volume[83167]: INFO cinder.image.image_utils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Image download 20.69 MB at 20.69 MB/s Feb 27 02:04:50 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccef69c6-0ece-4655-aaf8-b88f35d43e01]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_be6qi5acdevstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:50 devstack sudo[86540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_be6qi5acdevstack@QuobyteHD Feb 27 02:04:50 devstack sudo[86540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:50 devstack sudo[86535]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8" returned: 0 in 0.959s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:50 devstack sudo[86545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 Feb 27 02:04:50 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:51 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4f7c6f40-5408-4991-9db3-6143d793ef71" returned: 0 in 0.997s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] <== create_volume: return (2978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.980s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e7f8c6-ab52-4822-8ba1-fe74f03d3645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f7c6f40-5408-4991-9db3-6143d793ef71', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a583700-7500-483b-bbd9-cf43644dfd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:51 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Volume volume-4f7c6f40-5408-4991-9db3-6143d793ef71 (4f7c6f40-5408-4991-9db3-6143d793ef71): created successfully Feb 27 02:04:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a583700-7500-483b-bbd9-cf43644dfd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Flow 'volume_create_manager' (29336917-1252-4129-ba99-a30b9c8c5c4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:51 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-cd86f593-3900-4a57-bd5b-6ff9b4942b34 tempest-VolumeQuotasAdminTestJSON-115296742 None] Created volume successfully. Feb 27 02:04:51 devstack sudo[86540]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_be6qi5acdevstack@QuobyteHD" returned: 0 in 1.115s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:51 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Temporary image 74e16fab-69df-4cb3-99da-0b06bc338767 is fetched for user dfe3dd27c4734936979324d5de2400aa. {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 02:04:51 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[15210441-ec0e-4c0b-9857-0953f16d7687]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_be6qi5acdevstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:51 devstack sudo[86552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_be6qi5acdevstack@QuobyteHD Feb 27 02:04:51 devstack sudo[86552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:51 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8" returned: 1 in 1.091s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:04:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:52 devstack sudo[86557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8 Feb 27 02:04:52 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:52 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-aa468862-8aa6-4c91-887a-508a66bb14ad tempest-VolumeQuotasAdminTestJSON-653004846 None] Transfer volume completed successfully. Feb 27 02:04:52 devstack sudo[86552]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_be6qi5acdevstack@QuobyteHD" returned: 0 in 1.055s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:49Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97fe86c9-8d57-402f-8a62-9ad5a7cbf469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffc3912d24584369bb34ad374b7dd153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:49Z,use_quota=True,user_id='dfe3dd27c4734936979324d5de2400aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Creating volume 97fe86c9-8d57-402f-8a62-9ad5a7cbf469 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:52 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:52 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 1073741824 Feb 27 02:04:52 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:52 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8" returned: 0 in 0.724s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] Lock "cinder-quobyte-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8" released by "delete_volume" :: held 2.840s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] Created reservations ['117dd54c-b87d-40cb-8eb7-12494f6a7fed', 'b898b6c5-e74e-4b47-b0dc-146f8d29b1f1', 'eaf52de6-239c-4fc4-95bb-5116b9bb087e', 'a15dd2b3-cfec-4680-8df3-015e35915e8b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:52 devstack sudo[86566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:04:52 devstack sudo[86566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:53 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 1073741824" returned: 0 in 1.218s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:53 devstack sudo[86579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 Feb 27 02:04:53 devstack sudo[86579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-13f6342f-0f80-4885-a9b2-c08adfa9f676 tempest-VolumeQuotasAdminTestJSON-1322649562 None] Acquiring lock "cinder-4f7c6f40-5408-4991-9db3-6143d793ef71-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-13f6342f-0f80-4885-a9b2-c08adfa9f676 tempest-VolumeQuotasAdminTestJSON-1322649562 None] Lock "cinder-4f7c6f40-5408-4991-9db3-6143d793ef71-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:53 devstack sudo[86566]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 1.125s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:53 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:53 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] Deleted volume successfully. Feb 27 02:04:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-13f6342f-0f80-4885-a9b2-c08adfa9f676 tempest-VolumeQuotasAdminTestJSON-1322649562 None] Acquiring lock "cinder-quobyte-4f7c6f40-5408-4991-9db3-6143d793ef71" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6fe9d767-b28d-4533-8ed8-acb1cf3b84fa tempest-VolumesImageMetadata-1081926020 None] Lock "cinder-af354be9-f0ac-4a9a-8d8a-11de7d9d3bd8-delete_volume" released by "delete_volume" :: held 4.354s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-13f6342f-0f80-4885-a9b2-c08adfa9f676 tempest-VolumeQuotasAdminTestJSON-1322649562 None] Lock "cinder-quobyte-4f7c6f40-5408-4991-9db3-6143d793ef71" acquired by "delete_volume" :: waited 0.018s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:54 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acbe618-4b96-4764-b15b-9ceff978822c]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-13f6342f-0f80-4885-a9b2-c08adfa9f676 tempest-VolumeQuotasAdminTestJSON-1322649562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4f7c6f40-5408-4991-9db3-6143d793ef71 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:54 devstack sudo[86581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4f7c6f40-5408-4991-9db3-6143d793ef71 Feb 27 02:04:54 devstack sudo[86581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:55 devstack sudo[86579]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469" returned: 0 in 1.220s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] <== create_volume: return (2493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.496s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:55 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Attempting download of 74e16fab-69df-4cb3-99da-0b06bc338767 ((None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}])) to volume 97fe86c9-8d57-402f-8a62-9ad5a7cbf469. {{(pid=83167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 02:04:55 devstack sudo[86581]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-13f6342f-0f80-4885-a9b2-c08adfa9f676 tempest-VolumeQuotasAdminTestJSON-1322649562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4f7c6f40-5408-4991-9db3-6143d793ef71" returned: 0 in 1.084s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-13f6342f-0f80-4885-a9b2-c08adfa9f676 tempest-VolumeQuotasAdminTestJSON-1322649562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4f7c6f40-5408-4991-9db3-6143d793ef71 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:55 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4f7c6f40-5408-4991-9db3-6143d793ef71 Feb 27 02:04:55 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:55 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff70f427-1ce2-4e13-9e0d-843ab0ca0c7a]: (4, 'raw') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_mi2i873q {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:55 devstack sudo[86589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_mi2i873q Feb 27 02:04:55 devstack sudo[86589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:55 devstack sudo[86589]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_mi2i873q" returned: 0 in 0.725s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_mi2i873q {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:56 devstack sudo[86616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_mi2i873q Feb 27 02:04:56 devstack sudo[86616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:56 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-13f6342f-0f80-4885-a9b2-c08adfa9f676 tempest-VolumeQuotasAdminTestJSON-1322649562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4f7c6f40-5408-4991-9db3-6143d793ef71" returned: 0 in 1.040s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-13f6342f-0f80-4885-a9b2-c08adfa9f676 tempest-VolumeQuotasAdminTestJSON-1322649562 None] Lock "cinder-quobyte-4f7c6f40-5408-4991-9db3-6143d793ef71" released by "delete_volume" :: held 2.162s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-13f6342f-0f80-4885-a9b2-c08adfa9f676 tempest-VolumeQuotasAdminTestJSON-1322649562 None] Created reservations ['0eab8c25-e1dd-42bc-a7d0-79cc4cb511f7', '3b70da9e-b2c5-4775-8807-8945f97da783', 'a453b4d1-72af-422a-aa26-d3ab3ae461ac', '65d1d2c8-cae0-418d-af89-99c543ddad66'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-13f6342f-0f80-4885-a9b2-c08adfa9f676 tempest-VolumeQuotasAdminTestJSON-1322649562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-13f6342f-0f80-4885-a9b2-c08adfa9f676 tempest-VolumeQuotasAdminTestJSON-1322649562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-13f6342f-0f80-4885-a9b2-c08adfa9f676 tempest-VolumeQuotasAdminTestJSON-1322649562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-13f6342f-0f80-4885-a9b2-c08adfa9f676 tempest-VolumeQuotasAdminTestJSON-1322649562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-13f6342f-0f80-4885-a9b2-c08adfa9f676 tempest-VolumeQuotasAdminTestJSON-1322649562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-13f6342f-0f80-4885-a9b2-c08adfa9f676 tempest-VolumeQuotasAdminTestJSON-1322649562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:56 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:04:56 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Flow 'volume_create_manager' (40b1f693-5e65-45d1-ad4c-4b0b94736574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01aa8c6d-f10b-4acf-86f2-8b13ce073b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01aa8c6d-f10b-4acf-86f2-8b13ce073b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1609052154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf719e39-d66d-49f3-8d4f-7544074963bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c6855f8efb48bcbbfff5990a842ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:57Z,use_quota=True,user_id='017dbf992602466cb62e3a84290b1e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c4cc63-322b-4281-aada-5cbabcdc672b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c4cc63-322b-4281-aada-5cbabcdc672b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc71fb55-1f0b-451d-948e-78ddecf9f81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc71fb55-1f0b-451d-948e-78ddecf9f81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf719e39-d66d-49f3-8d4f-7544074963bc', 'volume_name': 'volume-bf719e39-d66d-49f3-8d4f-7544074963bc', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f49709-b05b-4336-b46a-de4bd2141848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f49709-b05b-4336-b46a-de4bd2141848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c98ab33-4484-4908-8af5-fc3941c28270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:56 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Volume bf719e39-d66d-49f3-8d4f-7544074963bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf719e39-d66d-49f3-8d4f-7544074963bc', 'volume_size': 1} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1609052154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf719e39-d66d-49f3-8d4f-7544074963bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c6855f8efb48bcbbfff5990a842ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:57Z,use_quota=True,user_id='017dbf992602466cb62e3a84290b1e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Creating volume bf719e39-d66d-49f3-8d4f-7544074963bc {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:56 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:04:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bf719e39-d66d-49f3-8d4f-7544074963bc 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:56 devstack sudo[86622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bf719e39-d66d-49f3-8d4f-7544074963bc 1073741824 Feb 27 02:04:56 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:57 devstack sudo[86616]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_mi2i873q" returned: 1 in 1.128s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_mi2i873q' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:04:57 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9538c359-d09a-4ff7-97dc-1ec6bc0190b3]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_be6qi5acdevstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:57 devstack sudo[86624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_be6qi5acdevstack@QuobyteHD Feb 27 02:04:57 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:57 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-13f6342f-0f80-4885-a9b2-c08adfa9f676 tempest-VolumeQuotasAdminTestJSON-1322649562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.845s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:57 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-13f6342f-0f80-4885-a9b2-c08adfa9f676 tempest-VolumeQuotasAdminTestJSON-1322649562 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:57 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-13f6342f-0f80-4885-a9b2-c08adfa9f676 tempest-VolumeQuotasAdminTestJSON-1322649562 None] Deleted volume successfully. Feb 27 02:04:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-13f6342f-0f80-4885-a9b2-c08adfa9f676 tempest-VolumeQuotasAdminTestJSON-1322649562 None] Lock "cinder-4f7c6f40-5408-4991-9db3-6143d793ef71-delete_volume" released by "delete_volume" :: held 3.467s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:57 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bf719e39-d66d-49f3-8d4f-7544074963bc 1073741824" returned: 0 in 0.977s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bf719e39-d66d-49f3-8d4f-7544074963bc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:57 devstack sudo[86631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bf719e39-d66d-49f3-8d4f-7544074963bc Feb 27 02:04:57 devstack sudo[86631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:58 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_be6qi5acdevstack@QuobyteHD" returned: 0 in 0.958s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:58 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] 74e16fab-69df-4cb3-99da-0b06bc338767 was qcow2, converting to raw {{(pid=83167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 02:04:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_be6qi5acdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:58 devstack sudo[86636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_be6qi5acdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 Feb 27 02:04:58 devstack sudo[86636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:58 devstack sudo[86631]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bf719e39-d66d-49f3-8d4f-7544074963bc" returned: 0 in 1.144s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] <== create_volume: return (2168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.170s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c98ab33-4484-4908-8af5-fc3941c28270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf719e39-d66d-49f3-8d4f-7544074963bc', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6bc5931-520c-46c0-92b9-1770633fca78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:59 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Volume volume-bf719e39-d66d-49f3-8d4f-7544074963bc (bf719e39-d66d-49f3-8d4f-7544074963bc): created successfully Feb 27 02:04:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6bc5931-520c-46c0-92b9-1770633fca78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Flow 'volume_create_manager' (40b1f693-5e65-45d1-ad4c-4b0b94736574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:59 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3d53844a-b15c-4030-8d53-5fbbc1edb946 tempest-VolumesMetadataTest-568871265 None] Created volume successfully. Feb 27 02:05:00 devstack sudo[86636]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_be6qi5acdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469" returned: 0 in 2.116s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:00 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_be6qi5acdevstack@QuobyteHD, size 112.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:05:00 devstack cinder-volume[83167]: INFO cinder.image.image_utils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Converted 112.00 MB image at 52.89 MB/s Feb 27 02:05:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:00 devstack sudo[86652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 1G Feb 27 02:05:00 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:00 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 1G" returned: 0 in 0.741s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:00 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7016ceb0-f7fb-4398-83a8-70dee8b277da]: (4, 'raw') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:01 devstack sudo[86662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 Feb 27 02:05:01 devstack sudo[86662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-446b16e7-3407-4c02-9ed5-3d258f725dce tempest-VolumesMetadataTest-568871265 None] Acquiring lock "cinder-bf719e39-d66d-49f3-8d4f-7544074963bc-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-446b16e7-3407-4c02-9ed5-3d258f725dce tempest-VolumesMetadataTest-568871265 None] Lock "cinder-bf719e39-d66d-49f3-8d4f-7544074963bc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-446b16e7-3407-4c02-9ed5-3d258f725dce tempest-VolumesMetadataTest-568871265 None] Acquiring lock "cinder-quobyte-bf719e39-d66d-49f3-8d4f-7544074963bc" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-446b16e7-3407-4c02-9ed5-3d258f725dce tempest-VolumesMetadataTest-568871265 None] Lock "cinder-quobyte-bf719e39-d66d-49f3-8d4f-7544074963bc" acquired by "delete_volume" :: waited 0.036s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:01 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8893df49-ec2c-4332-9c05-869e33a7acaf]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-446b16e7-3407-4c02-9ed5-3d258f725dce tempest-VolumesMetadataTest-568871265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bf719e39-d66d-49f3-8d4f-7544074963bc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:01 devstack sudo[86665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bf719e39-d66d-49f3-8d4f-7544074963bc Feb 27 02:05:01 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:02 devstack sudo[86662]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469" returned: 0 in 1.380s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:02 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-446b16e7-3407-4c02-9ed5-3d258f725dce tempest-VolumesMetadataTest-568871265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bf719e39-d66d-49f3-8d4f-7544074963bc" returned: 0 in 1.089s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-446b16e7-3407-4c02-9ed5-3d258f725dce tempest-VolumesMetadataTest-568871265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bf719e39-d66d-49f3-8d4f-7544074963bc {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:02 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bf719e39-d66d-49f3-8d4f-7544074963bc Feb 27 02:05:02 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:02 devstack sudo[86672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 Feb 27 02:05:02 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:03 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469" returned: 1 in 1.428s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:05:03 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Downloaded image 74e16fab-69df-4cb3-99da-0b06bc338767 ((None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}])) to volume 97fe86c9-8d57-402f-8a62-9ad5a7cbf469 successfully. {{(pid=83167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 02:05:03 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Temporary image 74e16fab-69df-4cb3-99da-0b06bc338767 for user dfe3dd27c4734936979324d5de2400aa is deleted. {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 02:05:03 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Marking volume 97fe86c9-8d57-402f-8a62-9ad5a7cbf469 as bootable. {{(pid=83167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 02:05:03 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Copying metadata from image 74e16fab-69df-4cb3-99da-0b06bc338767 to 97fe86c9-8d57-402f-8a62-9ad5a7cbf469. {{(pid=83167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 02:05:03 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Creating volume glance metadata for volume 97fe86c9-8d57-402f-8a62-9ad5a7cbf469 backed by image 74e16fab-69df-4cb3-99da-0b06bc338767 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 02:05:03 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-446b16e7-3407-4c02-9ed5-3d258f725dce tempest-VolumesMetadataTest-568871265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bf719e39-d66d-49f3-8d4f-7544074963bc" returned: 0 in 1.332s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-446b16e7-3407-4c02-9ed5-3d258f725dce tempest-VolumesMetadataTest-568871265 None] Lock "cinder-quobyte-bf719e39-d66d-49f3-8d4f-7544074963bc" released by "delete_volume" :: held 2.488s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (049b584e-f431-44ea-8300-1343bbed0b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469', 'volume_size': 1, 'image_id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c3ebea7eea44d62b013a3b663b3a45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74e16fab-69df-4cb3-99da-0b06bc338767/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d06ed8-cd96-4d78-ad67-1de9471d1635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:03 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Volume volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 (97fe86c9-8d57-402f-8a62-9ad5a7cbf469): created successfully Feb 27 02:05:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d06ed8-cd96-4d78-ad67-1de9471d1635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Flow 'volume_create_manager' (117a7901-c4d1-48b1-9c3d-386998936c4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:03 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-e1371f98-a76f-4971-8d9d-20c7d8309d5b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Created volume successfully. Feb 27 02:05:03 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-446b16e7-3407-4c02-9ed5-3d258f725dce tempest-VolumesMetadataTest-568871265 None] Created reservations ['8ca4c76d-b527-4b66-aea9-82e268a9d0ba', 'f153c7b7-72b1-41af-b1ba-714bed0fdd6c', '3066e4ce-e995-4222-a425-25497cb30bd1', '922b6904-2c62-4c1e-8017-81d307c031f6'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-446b16e7-3407-4c02-9ed5-3d258f725dce tempest-VolumesMetadataTest-568871265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-446b16e7-3407-4c02-9ed5-3d258f725dce tempest-VolumesMetadataTest-568871265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-446b16e7-3407-4c02-9ed5-3d258f725dce tempest-VolumesMetadataTest-568871265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-446b16e7-3407-4c02-9ed5-3d258f725dce tempest-VolumesMetadataTest-568871265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-446b16e7-3407-4c02-9ed5-3d258f725dce tempest-VolumesMetadataTest-568871265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-446b16e7-3407-4c02-9ed5-3d258f725dce tempest-VolumesMetadataTest-568871265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:04 devstack sudo[86680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:05:04 devstack sudo[86680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:04 devstack sudo[86680]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-446b16e7-3407-4c02-9ed5-3d258f725dce tempest-VolumesMetadataTest-568871265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.852s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:04 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-446b16e7-3407-4c02-9ed5-3d258f725dce tempest-VolumesMetadataTest-568871265 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:04 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-446b16e7-3407-4c02-9ed5-3d258f725dce tempest-VolumesMetadataTest-568871265 None] Deleted volume successfully. Feb 27 02:05:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-446b16e7-3407-4c02-9ed5-3d258f725dce tempest-VolumesMetadataTest-568871265 None] Lock "cinder-bf719e39-d66d-49f3-8d4f-7544074963bc-delete_volume" released by "delete_volume" :: held 3.726s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-3ff518f4-3e7a-427a-aa22-1c56a4ddbf74 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-3ff518f4-3e7a-427a-aa22-1c56a4ddbf74 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.011s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:05 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5385381c-aef1-48a0-92e5-9ed1e47a5e89]: (4, 'raw') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-3ff518f4-3e7a-427a-aa22-1c56a4ddbf74 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:05 devstack sudo[86692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 Feb 27 02:05:05 devstack sudo[86692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:05 devstack sudo[86692]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-3ff518f4-3e7a-427a-aa22-1c56a4ddbf74 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469" returned: 0 in 0.799s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-3ff518f4-3e7a-427a-aa22-1c56a4ddbf74 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:06 devstack sudo[86696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 Feb 27 02:05:06 devstack sudo[86696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:06 devstack sudo[86696]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-3ff518f4-3e7a-427a-aa22-1c56a4ddbf74 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469" returned: 1 in 0.942s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-3ff518f4-3e7a-427a-aa22-1c56a4ddbf74 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:05:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-3ff518f4-3e7a-427a-aa22-1c56a4ddbf74 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.824s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-3ff518f4-3e7a-427a-aa22-1c56a4ddbf74 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb', 'name': 'volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0eb8db16-ab15-4e26-a00a-749dedf6acad', 'enforce_multipath': True} {{(pid=83167) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 02:05:06 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-31dcfa39-0fe8-4b68-b8e0-92d2c36e1bf1 req-3ff518f4-3e7a-427a-aa22-1c56a4ddbf74 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] attachment_update completed successfully. Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Flow 'volume_create_manager' (8775f580-98dd-4165-be14-2ad7401a3cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f528d0-6219-4154-8765-8486ad715d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f528d0-6219-4154-8765-8486ad715d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2109166097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69fe58dc-0985-4434-91e9-c88f58883c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9cc49de34cf4b7b966b29dadfebd4bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:09Z,use_quota=True,user_id='b889782481b74cebb65ad517ec8725d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14144861-b851-497a-a260-6e2113b720bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14144861-b851-497a-a260-6e2113b720bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3b4bb7-a3d7-4114-8434-89777244fcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3b4bb7-a3d7-4114-8434-89777244fcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69fe58dc-0985-4434-91e9-c88f58883c1f', 'volume_name': 'volume-69fe58dc-0985-4434-91e9-c88f58883c1f', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0a151e-4c3f-4b2f-b10e-6bbbd3f7dbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0a151e-4c3f-4b2f-b10e-6bbbd3f7dbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44de2e61-0551-44c4-85a2-5b92c534a13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:08 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Volume 69fe58dc-0985-4434-91e9-c88f58883c1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69fe58dc-0985-4434-91e9-c88f58883c1f', 'volume_size': 1} Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2109166097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69fe58dc-0985-4434-91e9-c88f58883c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9cc49de34cf4b7b966b29dadfebd4bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:09Z,use_quota=True,user_id='b889782481b74cebb65ad517ec8725d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Creating volume 69fe58dc-0985-4434-91e9-c88f58883c1f {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:08 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:05:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-69fe58dc-0985-4434-91e9-c88f58883c1f 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:08 devstack sudo[86702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-69fe58dc-0985-4434-91e9-c88f58883c1f 1073741824 Feb 27 02:05:08 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:09 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-69fe58dc-0985-4434-91e9-c88f58883c1f 1073741824" returned: 0 in 0.668s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-69fe58dc-0985-4434-91e9-c88f58883c1f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:09 devstack sudo[86707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-69fe58dc-0985-4434-91e9-c88f58883c1f Feb 27 02:05:09 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:10 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-69fe58dc-0985-4434-91e9-c88f58883c1f" returned: 0 in 0.665s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44de2e61-0551-44c4-85a2-5b92c534a13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69fe58dc-0985-4434-91e9-c88f58883c1f', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a20b0054-fd61-4834-9b55-c39b1cc87a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:10 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Volume volume-69fe58dc-0985-4434-91e9-c88f58883c1f (69fe58dc-0985-4434-91e9-c88f58883c1f): created successfully Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a20b0054-fd61-4834-9b55-c39b1cc87a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Flow 'volume_create_manager' (8775f580-98dd-4165-be14-2ad7401a3cd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:10 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-0ced6dcf-e298-490c-b11a-c804f28e03a8 tempest-VolumesServicesTestJSON-2106654650 None] Created volume successfully. Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Flow 'volume_create_manager' (0ca0440b-827a-4d99-8d58-3fc89d2ac9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ecf7f7-9db6-42d2-ba07-c53618b8abf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ecf7f7-9db6-42d2-ba07-c53618b8abf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-507973484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39986a30-8272-4524-b069-306fb72395bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2450fc01c1b64a68a0c84e1b7d9798cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:10Z,use_quota=True,user_id='24ba902327854df2ae2e6829b48407ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ef731e-e494-46b8-846d-f6a9fbc5a480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ef731e-e494-46b8-846d-f6a9fbc5a480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed86234c-a421-457e-bb12-e18cbf7763e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed86234c-a421-457e-bb12-e18cbf7763e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39986a30-8272-4524-b069-306fb72395bf', 'volume_name': 'volume-39986a30-8272-4524-b069-306fb72395bf', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fac1464-cf72-4ea1-b711-3c1b94b6639d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fac1464-cf72-4ea1-b711-3c1b94b6639d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5250ff9-97ed-47f8-be2d-0a84daeecae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:10 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Volume 39986a30-8272-4524-b069-306fb72395bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39986a30-8272-4524-b069-306fb72395bf', 'volume_size': 1} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-507973484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39986a30-8272-4524-b069-306fb72395bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2450fc01c1b64a68a0c84e1b7d9798cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:10Z,use_quota=True,user_id='24ba902327854df2ae2e6829b48407ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Creating volume 39986a30-8272-4524-b069-306fb72395bf {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:10 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-39986a30-8272-4524-b069-306fb72395bf 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:10 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-39986a30-8272-4524-b069-306fb72395bf 1073741824 Feb 27 02:05:10 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ed7788cd-07c2-4eee-bdfd-93529c884c5c tempest-VolumesServicesTestJSON-2106654650 None] Acquiring lock "cinder-69fe58dc-0985-4434-91e9-c88f58883c1f-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ed7788cd-07c2-4eee-bdfd-93529c884c5c tempest-VolumesServicesTestJSON-2106654650 None] Lock "cinder-69fe58dc-0985-4434-91e9-c88f58883c1f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ed7788cd-07c2-4eee-bdfd-93529c884c5c tempest-VolumesServicesTestJSON-2106654650 None] Acquiring lock "cinder-quobyte-69fe58dc-0985-4434-91e9-c88f58883c1f" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ed7788cd-07c2-4eee-bdfd-93529c884c5c tempest-VolumesServicesTestJSON-2106654650 None] Lock "cinder-quobyte-69fe58dc-0985-4434-91e9-c88f58883c1f" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e375f98-98fe-43d2-80e9-5764f8aa53cb]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ed7788cd-07c2-4eee-bdfd-93529c884c5c tempest-VolumesServicesTestJSON-2106654650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-69fe58dc-0985-4434-91e9-c88f58883c1f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:11 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-39986a30-8272-4524-b069-306fb72395bf 1073741824" returned: 0 in 0.725s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-39986a30-8272-4524-b069-306fb72395bf {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:11 devstack sudo[86718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-69fe58dc-0985-4434-91e9-c88f58883c1f Feb 27 02:05:11 devstack sudo[86718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:11 devstack sudo[86719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-39986a30-8272-4524-b069-306fb72395bf Feb 27 02:05:11 devstack sudo[86719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:11 devstack sudo[86719]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-39986a30-8272-4524-b069-306fb72395bf" returned: 0 in 0.545s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5250ff9-97ed-47f8-be2d-0a84daeecae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39986a30-8272-4524-b069-306fb72395bf', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250fafb0-8a61-4c2f-bd0f-ab9b0ec1114f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:11 devstack sudo[86718]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:11 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Volume volume-39986a30-8272-4524-b069-306fb72395bf (39986a30-8272-4524-b069-306fb72395bf): created successfully Feb 27 02:05:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250fafb0-8a61-4c2f-bd0f-ab9b0ec1114f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Flow 'volume_create_manager' (0ca0440b-827a-4d99-8d58-3fc89d2ac9fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ed7788cd-07c2-4eee-bdfd-93529c884c5c tempest-VolumesServicesTestJSON-2106654650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-69fe58dc-0985-4434-91e9-c88f58883c1f" returned: 0 in 0.684s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ed7788cd-07c2-4eee-bdfd-93529c884c5c tempest-VolumesServicesTestJSON-2106654650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-69fe58dc-0985-4434-91e9-c88f58883c1f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:11 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a99f4eb2-7158-4241-957d-2c96ea48211c tempest-VolumesTransfersV355Test-1128479337 None] Created volume successfully. Feb 27 02:05:11 devstack sudo[86726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-69fe58dc-0985-4434-91e9-c88f58883c1f Feb 27 02:05:11 devstack sudo[86726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:12 devstack sudo[86726]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ed7788cd-07c2-4eee-bdfd-93529c884c5c tempest-VolumesServicesTestJSON-2106654650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-69fe58dc-0985-4434-91e9-c88f58883c1f" returned: 0 in 0.586s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ed7788cd-07c2-4eee-bdfd-93529c884c5c tempest-VolumesServicesTestJSON-2106654650 None] Lock "cinder-quobyte-69fe58dc-0985-4434-91e9-c88f58883c1f" released by "delete_volume" :: held 1.301s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:12 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ed7788cd-07c2-4eee-bdfd-93529c884c5c tempest-VolumesServicesTestJSON-2106654650 None] Created reservations ['3023443b-91e4-4e5e-afa4-3291dbffac88', '01de0154-1e79-4260-aec3-1aeb6edb30d5', 'c04aa9a5-926a-475d-8569-67e6df354fc4', '46530a9d-8a60-4bd0-ae4f-5b7e9f172311'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ed7788cd-07c2-4eee-bdfd-93529c884c5c tempest-VolumesServicesTestJSON-2106654650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ed7788cd-07c2-4eee-bdfd-93529c884c5c tempest-VolumesServicesTestJSON-2106654650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ed7788cd-07c2-4eee-bdfd-93529c884c5c tempest-VolumesServicesTestJSON-2106654650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ed7788cd-07c2-4eee-bdfd-93529c884c5c tempest-VolumesServicesTestJSON-2106654650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ed7788cd-07c2-4eee-bdfd-93529c884c5c tempest-VolumesServicesTestJSON-2106654650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ed7788cd-07c2-4eee-bdfd-93529c884c5c tempest-VolumesServicesTestJSON-2106654650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:12 devstack sudo[86752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:05:12 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:13 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:13 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3ea0e88b-2e32-4cb5-9665-c595f26e65d3 tempest-VolumesTransfersV355Test-1804084002 None] Transfer volume completed successfully. Feb 27 02:05:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ed7788cd-07c2-4eee-bdfd-93529c884c5c tempest-VolumesServicesTestJSON-2106654650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.671s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:13 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-ed7788cd-07c2-4eee-bdfd-93529c884c5c tempest-VolumesServicesTestJSON-2106654650 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:13 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ed7788cd-07c2-4eee-bdfd-93529c884c5c tempest-VolumesServicesTestJSON-2106654650 None] Deleted volume successfully. Feb 27 02:05:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ed7788cd-07c2-4eee-bdfd-93529c884c5c tempest-VolumesServicesTestJSON-2106654650 None] Lock "cinder-69fe58dc-0985-4434-91e9-c88f58883c1f-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7a2ab0db-25dd-4331-aa74-5dbd79a8d2f1 tempest-VolumesTransfersV355Test-733102435 None] Acquiring lock "cinder-39986a30-8272-4524-b069-306fb72395bf-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7a2ab0db-25dd-4331-aa74-5dbd79a8d2f1 tempest-VolumesTransfersV355Test-733102435 None] Lock "cinder-39986a30-8272-4524-b069-306fb72395bf-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7a2ab0db-25dd-4331-aa74-5dbd79a8d2f1 tempest-VolumesTransfersV355Test-733102435 None] Acquiring lock "cinder-quobyte-39986a30-8272-4524-b069-306fb72395bf" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7a2ab0db-25dd-4331-aa74-5dbd79a8d2f1 tempest-VolumesTransfersV355Test-733102435 None] Lock "cinder-quobyte-39986a30-8272-4524-b069-306fb72395bf" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:14 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c7be3c-707c-439e-9f84-562bf691da66]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7a2ab0db-25dd-4331-aa74-5dbd79a8d2f1 tempest-VolumesTransfersV355Test-733102435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-39986a30-8272-4524-b069-306fb72395bf {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:14 devstack sudo[86755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-39986a30-8272-4524-b069-306fb72395bf Feb 27 02:05:14 devstack sudo[86755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:14 devstack sudo[86755]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7a2ab0db-25dd-4331-aa74-5dbd79a8d2f1 tempest-VolumesTransfersV355Test-733102435 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-39986a30-8272-4524-b069-306fb72395bf" returned: 0 in 0.726s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7a2ab0db-25dd-4331-aa74-5dbd79a8d2f1 tempest-VolumesTransfersV355Test-733102435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-39986a30-8272-4524-b069-306fb72395bf {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:14 devstack sudo[86762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-39986a30-8272-4524-b069-306fb72395bf Feb 27 02:05:14 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:15 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7a2ab0db-25dd-4331-aa74-5dbd79a8d2f1 tempest-VolumesTransfersV355Test-733102435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-39986a30-8272-4524-b069-306fb72395bf" returned: 0 in 0.674s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7a2ab0db-25dd-4331-aa74-5dbd79a8d2f1 tempest-VolumesTransfersV355Test-733102435 None] Lock "cinder-quobyte-39986a30-8272-4524-b069-306fb72395bf" released by "delete_volume" :: held 1.435s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:15 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-7a2ab0db-25dd-4331-aa74-5dbd79a8d2f1 tempest-VolumesTransfersV355Test-733102435 None] Created reservations ['4e256bfe-ebfa-461a-823d-b7e9056a567e', '21916500-d24e-4425-ad70-88ec41f29b56', '9493e0e6-e04f-40bd-b83f-c4c704e27229', '0ab6e1c1-b4df-4785-bf8a-97212a8160f1'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7a2ab0db-25dd-4331-aa74-5dbd79a8d2f1 tempest-VolumesTransfersV355Test-733102435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7a2ab0db-25dd-4331-aa74-5dbd79a8d2f1 tempest-VolumesTransfersV355Test-733102435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7a2ab0db-25dd-4331-aa74-5dbd79a8d2f1 tempest-VolumesTransfersV355Test-733102435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7a2ab0db-25dd-4331-aa74-5dbd79a8d2f1 tempest-VolumesTransfersV355Test-733102435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7a2ab0db-25dd-4331-aa74-5dbd79a8d2f1 tempest-VolumesTransfersV355Test-733102435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7a2ab0db-25dd-4331-aa74-5dbd79a8d2f1 tempest-VolumesTransfersV355Test-733102435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:15 devstack sudo[86767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:05:15 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:16 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7a2ab0db-25dd-4331-aa74-5dbd79a8d2f1 tempest-VolumesTransfersV355Test-733102435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 1.267s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-7a2ab0db-25dd-4331-aa74-5dbd79a8d2f1 tempest-VolumesTransfersV355Test-733102435 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Flow 'volume_create_manager' (5b32852e-9615-4161-abdc-6737e255edda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd6eb697-681f-439a-838e-ae07564e9907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:17 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7a2ab0db-25dd-4331-aa74-5dbd79a8d2f1 tempest-VolumesTransfersV355Test-733102435 None] Deleted volume successfully. Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd6eb697-681f-439a-838e-ae07564e9907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-627782759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5be6f5a-4807-4305-b8dc-81fddbfe3475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2450fc01c1b64a68a0c84e1b7d9798cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:17Z,use_quota=True,user_id='24ba902327854df2ae2e6829b48407ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a96136a-a190-45d5-81ee-79f113086301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a96136a-a190-45d5-81ee-79f113086301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0258bf-6cf0-4a11-bf3f-90ef0c0d98f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0258bf-6cf0-4a11-bf3f-90ef0c0d98f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5be6f5a-4807-4305-b8dc-81fddbfe3475', 'volume_name': 'volume-e5be6f5a-4807-4305-b8dc-81fddbfe3475', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de38329-1159-46a3-a581-07a70cea7447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de38329-1159-46a3-a581-07a70cea7447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3cf583-485f-4b8f-895d-f80008016fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:17 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Volume e5be6f5a-4807-4305-b8dc-81fddbfe3475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5be6f5a-4807-4305-b8dc-81fddbfe3475', 'volume_size': 1} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-627782759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5be6f5a-4807-4305-b8dc-81fddbfe3475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2450fc01c1b64a68a0c84e1b7d9798cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:17Z,use_quota=True,user_id='24ba902327854df2ae2e6829b48407ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Creating volume e5be6f5a-4807-4305-b8dc-81fddbfe3475 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:17 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e5be6f5a-4807-4305-b8dc-81fddbfe3475 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7a2ab0db-25dd-4331-aa74-5dbd79a8d2f1 tempest-VolumesTransfersV355Test-733102435 None] Lock "cinder-39986a30-8272-4524-b069-306fb72395bf-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:17 devstack sudo[86771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e5be6f5a-4807-4305-b8dc-81fddbfe3475 1073741824 Feb 27 02:05:17 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:18 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e5be6f5a-4807-4305-b8dc-81fddbfe3475 1073741824" returned: 0 in 1.414s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e5be6f5a-4807-4305-b8dc-81fddbfe3475 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:18 devstack sudo[86777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e5be6f5a-4807-4305-b8dc-81fddbfe3475 Feb 27 02:05:18 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:19 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e5be6f5a-4807-4305-b8dc-81fddbfe3475" returned: 0 in 0.736s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] <== create_volume: return (2195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.197s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3cf583-485f-4b8f-895d-f80008016fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5be6f5a-4807-4305-b8dc-81fddbfe3475', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd25cb61-1780-4d91-83bc-5f0ed272b88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:19 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Volume volume-e5be6f5a-4807-4305-b8dc-81fddbfe3475 (e5be6f5a-4807-4305-b8dc-81fddbfe3475): created successfully Feb 27 02:05:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd25cb61-1780-4d91-83bc-5f0ed272b88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Flow 'volume_create_manager' (5b32852e-9615-4161-abdc-6737e255edda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:19 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-dd7b35c5-404e-40d3-b967-4cc4e3c5dd1e tempest-VolumesTransfersV355Test-1128479337 None] Created volume successfully. Feb 27 02:05:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d5546a1f-b5f0-4cb8-b437-c528ef8bb1b2 tempest-VolumesTransfersV355Test-733102435 None] Acquiring lock "cinder-e5be6f5a-4807-4305-b8dc-81fddbfe3475-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d5546a1f-b5f0-4cb8-b437-c528ef8bb1b2 tempest-VolumesTransfersV355Test-733102435 None] Lock "cinder-e5be6f5a-4807-4305-b8dc-81fddbfe3475-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d5546a1f-b5f0-4cb8-b437-c528ef8bb1b2 tempest-VolumesTransfersV355Test-733102435 None] Acquiring lock "cinder-quobyte-e5be6f5a-4807-4305-b8dc-81fddbfe3475" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d5546a1f-b5f0-4cb8-b437-c528ef8bb1b2 tempest-VolumesTransfersV355Test-733102435 None] Lock "cinder-quobyte-e5be6f5a-4807-4305-b8dc-81fddbfe3475" acquired by "delete_volume" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:20 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[28473e48-b60b-4024-81fa-043c1e1863fa]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d5546a1f-b5f0-4cb8-b437-c528ef8bb1b2 tempest-VolumesTransfersV355Test-733102435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e5be6f5a-4807-4305-b8dc-81fddbfe3475 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:20 devstack sudo[86780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e5be6f5a-4807-4305-b8dc-81fddbfe3475 Feb 27 02:05:20 devstack sudo[86780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:21 devstack sudo[86780]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d5546a1f-b5f0-4cb8-b437-c528ef8bb1b2 tempest-VolumesTransfersV355Test-733102435 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e5be6f5a-4807-4305-b8dc-81fddbfe3475" returned: 0 in 1.098s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d5546a1f-b5f0-4cb8-b437-c528ef8bb1b2 tempest-VolumesTransfersV355Test-733102435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e5be6f5a-4807-4305-b8dc-81fddbfe3475 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:21 devstack sudo[86785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e5be6f5a-4807-4305-b8dc-81fddbfe3475 Feb 27 02:05:21 devstack sudo[86785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:22 devstack sudo[86785]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d5546a1f-b5f0-4cb8-b437-c528ef8bb1b2 tempest-VolumesTransfersV355Test-733102435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e5be6f5a-4807-4305-b8dc-81fddbfe3475" returned: 0 in 0.479s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d5546a1f-b5f0-4cb8-b437-c528ef8bb1b2 tempest-VolumesTransfersV355Test-733102435 None] Lock "cinder-quobyte-e5be6f5a-4807-4305-b8dc-81fddbfe3475" released by "delete_volume" :: held 1.613s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:22 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-d5546a1f-b5f0-4cb8-b437-c528ef8bb1b2 tempest-VolumesTransfersV355Test-733102435 None] Created reservations ['f38dec3a-bf03-4de4-80bf-5071dee331cb', '79da8540-b017-4be3-a370-0ccd4ddd96ee', '11dc30df-60cc-4612-ad19-ff3dfc4e0762', 'f06b9b45-4524-4668-bdd7-2258821e1b6c'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d5546a1f-b5f0-4cb8-b437-c528ef8bb1b2 tempest-VolumesTransfersV355Test-733102435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d5546a1f-b5f0-4cb8-b437-c528ef8bb1b2 tempest-VolumesTransfersV355Test-733102435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d5546a1f-b5f0-4cb8-b437-c528ef8bb1b2 tempest-VolumesTransfersV355Test-733102435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d5546a1f-b5f0-4cb8-b437-c528ef8bb1b2 tempest-VolumesTransfersV355Test-733102435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d5546a1f-b5f0-4cb8-b437-c528ef8bb1b2 tempest-VolumesTransfersV355Test-733102435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d5546a1f-b5f0-4cb8-b437-c528ef8bb1b2 tempest-VolumesTransfersV355Test-733102435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:22 devstack sudo[86788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:05:22 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:23 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d5546a1f-b5f0-4cb8-b437-c528ef8bb1b2 tempest-VolumesTransfersV355Test-733102435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.773s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:23 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-d5546a1f-b5f0-4cb8-b437-c528ef8bb1b2 tempest-VolumesTransfersV355Test-733102435 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:23 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d5546a1f-b5f0-4cb8-b437-c528ef8bb1b2 tempest-VolumesTransfersV355Test-733102435 None] Deleted volume successfully. Feb 27 02:05:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d5546a1f-b5f0-4cb8-b437-c528ef8bb1b2 tempest-VolumesTransfersV355Test-733102435 None] Lock "cinder-e5be6f5a-4807-4305-b8dc-81fddbfe3475-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Flow 'volume_create_manager' (d1c39a56-1e72-4c4e-af40-56a9f437e928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cafed019-bf27-4b26-bbfe-642f2d299028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cafed019-bf27-4b26-bbfe-642f2d299028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-823199590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8300ea2b-5540-43dd-ab92-d613f523b31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8ff766fa6c443795b1884fea61be68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:25Z,use_quota=True,user_id='613b218dd2a243dcb69dcfb02c6edde6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42167f9c-0f8b-4d7f-8ba4-03ebee1f633b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42167f9c-0f8b-4d7f-8ba4-03ebee1f633b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d8773b-6669-452c-823f-1d950b057bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d8773b-6669-452c-823f-1d950b057bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8300ea2b-5540-43dd-ab92-d613f523b31a', 'volume_name': 'volume-8300ea2b-5540-43dd-ab92-d613f523b31a', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8589d2e9-a8bd-4741-9166-1a6021ec7042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8589d2e9-a8bd-4741-9166-1a6021ec7042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef07729-5e1b-4faa-b90d-418722c8b545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:24 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Volume 8300ea2b-5540-43dd-ab92-d613f523b31a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8300ea2b-5540-43dd-ab92-d613f523b31a', 'volume_size': 1} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-823199590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8300ea2b-5540-43dd-ab92-d613f523b31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8ff766fa6c443795b1884fea61be68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:25Z,use_quota=True,user_id='613b218dd2a243dcb69dcfb02c6edde6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Creating volume 8300ea2b-5540-43dd-ab92-d613f523b31a {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:24 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:05:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8300ea2b-5540-43dd-ab92-d613f523b31a 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:24 devstack sudo[86815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8300ea2b-5540-43dd-ab92-d613f523b31a 1073741824 Feb 27 02:05:24 devstack sudo[86815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:25 devstack sudo[86815]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8300ea2b-5540-43dd-ab92-d613f523b31a 1073741824" returned: 0 in 0.775s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8300ea2b-5540-43dd-ab92-d613f523b31a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:25 devstack sudo[86820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8300ea2b-5540-43dd-ab92-d613f523b31a Feb 27 02:05:25 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:26 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8300ea2b-5540-43dd-ab92-d613f523b31a" returned: 0 in 0.767s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef07729-5e1b-4faa-b90d-418722c8b545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8300ea2b-5540-43dd-ab92-d613f523b31a', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed6dd32-042c-4a8b-9331-43282e1bfa0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:26 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Volume volume-8300ea2b-5540-43dd-ab92-d613f523b31a (8300ea2b-5540-43dd-ab92-d613f523b31a): created successfully Feb 27 02:05:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed6dd32-042c-4a8b-9331-43282e1bfa0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:26 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Flow 'volume_create_manager' (d1c39a56-1e72-4c4e-af40-56a9f437e928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:26 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c8a723b4-010a-419b-a3e5-f789bc896440 tempest-VolumesListAdminTestJSON-1803217355 None] Created volume successfully. Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Flow 'volume_create_manager' (7548cdb6-1d8c-415c-93a3-01081289b966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a86762b-2f0a-48b4-834d-d8ada292a4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a86762b-2f0a-48b4-834d-d8ada292a4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1994570513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211f7a57-250d-45b3-9376-b2bc0a02c63d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8ff766fa6c443795b1884fea61be68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:27Z,use_quota=True,user_id='613b218dd2a243dcb69dcfb02c6edde6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30acbfd-7310-451c-baf8-5772dbe69daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30acbfd-7310-451c-baf8-5772dbe69daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d35f1a-6c6c-4435-9ba1-295688d209b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d35f1a-6c6c-4435-9ba1-295688d209b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '211f7a57-250d-45b3-9376-b2bc0a02c63d', 'volume_name': 'volume-211f7a57-250d-45b3-9376-b2bc0a02c63d', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e0befa-28e2-42cd-a884-6814e100ac0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e0befa-28e2-42cd-a884-6814e100ac0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3374e1e3-f3a1-4d97-9fce-a4e9ef58e4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:27 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Volume 211f7a57-250d-45b3-9376-b2bc0a02c63d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-211f7a57-250d-45b3-9376-b2bc0a02c63d', 'volume_size': 1} Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1994570513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211f7a57-250d-45b3-9376-b2bc0a02c63d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8ff766fa6c443795b1884fea61be68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:27Z,use_quota=True,user_id='613b218dd2a243dcb69dcfb02c6edde6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Creating volume 211f7a57-250d-45b3-9376-b2bc0a02c63d {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:27 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:05:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-211f7a57-250d-45b3-9376-b2bc0a02c63d 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:27 devstack sudo[86843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-211f7a57-250d-45b3-9376-b2bc0a02c63d 1073741824 Feb 27 02:05:27 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:28 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-211f7a57-250d-45b3-9376-b2bc0a02c63d 1073741824" returned: 0 in 0.719s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-211f7a57-250d-45b3-9376-b2bc0a02c63d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:28 devstack sudo[86850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-211f7a57-250d-45b3-9376-b2bc0a02c63d Feb 27 02:05:28 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:28 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-211f7a57-250d-45b3-9376-b2bc0a02c63d" returned: 0 in 0.752s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3374e1e3-f3a1-4d97-9fce-a4e9ef58e4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-211f7a57-250d-45b3-9376-b2bc0a02c63d', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90cbf7b0-9ca3-444d-938c-c9d63f747a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:28 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Volume volume-211f7a57-250d-45b3-9376-b2bc0a02c63d (211f7a57-250d-45b3-9376-b2bc0a02c63d): created successfully Feb 27 02:05:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90cbf7b0-9ca3-444d-938c-c9d63f747a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Flow 'volume_create_manager' (7548cdb6-1d8c-415c-93a3-01081289b966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:29 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-4a5867f4-64d8-4bb1-b1a4-6bb706a9fce5 tempest-VolumesListAdminTestJSON-1803217355 None] Created volume successfully. Feb 27 02:05:29 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Flow 'volume_create_manager' (3ee27da7-ad5e-419c-b296-4ce82864744c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959cd856-2237-4a7c-9a0b-3321840f1113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959cd856-2237-4a7c-9a0b-3321840f1113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1396429031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3face510-f909-49a2-8138-2fecc9d43086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8ff766fa6c443795b1884fea61be68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:30Z,use_quota=True,user_id='613b218dd2a243dcb69dcfb02c6edde6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24da709-c81b-4fcf-8f67-02ca9a9a1022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24da709-c81b-4fcf-8f67-02ca9a9a1022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1c1309-8ab5-425a-b12e-dec2617d7bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1c1309-8ab5-425a-b12e-dec2617d7bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3face510-f909-49a2-8138-2fecc9d43086', 'volume_name': 'volume-3face510-f909-49a2-8138-2fecc9d43086', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a740e0-9613-4b96-ae17-89bb0697fe33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a740e0-9613-4b96-ae17-89bb0697fe33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d33ba14-f499-4d42-91a3-b9bede5e3d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:30 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Volume 3face510-f909-49a2-8138-2fecc9d43086: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3face510-f909-49a2-8138-2fecc9d43086', 'volume_size': 1} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1396429031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3face510-f909-49a2-8138-2fecc9d43086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8ff766fa6c443795b1884fea61be68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:30Z,use_quota=True,user_id='613b218dd2a243dcb69dcfb02c6edde6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Creating volume 3face510-f909-49a2-8138-2fecc9d43086 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:30 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3face510-f909-49a2-8138-2fecc9d43086 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:30 devstack sudo[86855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3face510-f909-49a2-8138-2fecc9d43086 1073741824 Feb 27 02:05:30 devstack sudo[86855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:30 devstack sudo[86875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:05:30 devstack sudo[86875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:31 devstack sudo[86855]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3face510-f909-49a2-8138-2fecc9d43086 1073741824" returned: 0 in 1.105s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3face510-f909-49a2-8138-2fecc9d43086 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:31 devstack sudo[86901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3face510-f909-49a2-8138-2fecc9d43086 Feb 27 02:05:31 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:31 devstack sudo[86875]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 1.003s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:31 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:32 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3face510-f909-49a2-8138-2fecc9d43086" returned: 0 in 1.065s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] <== create_volume: return (2266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.268s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d33ba14-f499-4d42-91a3-b9bede5e3d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3face510-f909-49a2-8138-2fecc9d43086', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882639d0-865b-4862-9c96-6145cd3d5034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:32 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Volume volume-3face510-f909-49a2-8138-2fecc9d43086 (3face510-f909-49a2-8138-2fecc9d43086): created successfully Feb 27 02:05:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882639d0-865b-4862-9c96-6145cd3d5034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Flow 'volume_create_manager' (3ee27da7-ad5e-419c-b296-4ce82864744c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:32 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ccb2dc0c-8ee0-4258-970b-5d95c2374323 tempest-VolumesListAdminTestJSON-1803217355 None] Created volume successfully. Feb 27 02:05:33 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Flow 'volume_create_manager' (4caba9fe-caec-4a60-b24d-3b17fe2180a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dea8603-b86a-4b77-891e-1fd6288e137b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dea8603-b86a-4b77-891e-1fd6288e137b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e34e76d-bd88-437a-b73b-0f28954e160e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df32f3bd91bf43858d7d76b7b9fae6bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:34Z,use_quota=True,user_id='f3f56b9963514db695088157e35a1e84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb4d7ac-4009-4a8f-88c8-ab9afcb459ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb4d7ac-4009-4a8f-88c8-ab9afcb459ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:34 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3497a39-63f0-4ff4-8c8d-3e1402a2bbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:34 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3497a39-63f0-4ff4-8c8d-3e1402a2bbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e34e76d-bd88-437a-b73b-0f28954e160e', 'volume_name': 'volume-3e34e76d-bd88-437a-b73b-0f28954e160e', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:34 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92d4023-3eff-47fb-9729-00456fc59659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:34 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92d4023-3eff-47fb-9729-00456fc59659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:34 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a94efb4-2292-44de-b91c-c6e41f00876a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:34 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Volume 3e34e76d-bd88-437a-b73b-0f28954e160e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e34e76d-bd88-437a-b73b-0f28954e160e', 'volume_size': 1} Feb 27 02:05:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e34e76d-bd88-437a-b73b-0f28954e160e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df32f3bd91bf43858d7d76b7b9fae6bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:34Z,use_quota=True,user_id='f3f56b9963514db695088157e35a1e84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Creating volume 3e34e76d-bd88-437a-b73b-0f28954e160e {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:34 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:05:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3e34e76d-bd88-437a-b73b-0f28954e160e 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:34 devstack sudo[86914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3e34e76d-bd88-437a-b73b-0f28954e160e 1073741824 Feb 27 02:05:34 devstack sudo[86914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:35 devstack sudo[86914]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3e34e76d-bd88-437a-b73b-0f28954e160e 1073741824" returned: 0 in 0.983s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3e34e76d-bd88-437a-b73b-0f28954e160e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:35 devstack sudo[86956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3e34e76d-bd88-437a-b73b-0f28954e160e Feb 27 02:05:35 devstack sudo[86956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:35 devstack sudo[86956]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3e34e76d-bd88-437a-b73b-0f28954e160e" returned: 0 in 0.448s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a94efb4-2292-44de-b91c-c6e41f00876a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e34e76d-bd88-437a-b73b-0f28954e160e', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb8bf94-8d5e-4538-896d-863eef63b07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:35 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Volume volume-3e34e76d-bd88-437a-b73b-0f28954e160e (3e34e76d-bd88-437a-b73b-0f28954e160e): created successfully Feb 27 02:05:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb8bf94-8d5e-4538-896d-863eef63b07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Flow 'volume_create_manager' (4caba9fe-caec-4a60-b24d-3b17fe2180a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:35 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-419e7a5d-2d92-4b91-91a4-1ba2373b8be4 tempest-VolumesListAdminTestJSON-220473751 None] Created volume successfully. Feb 27 02:05:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c35b5b3f-42c2-4ed4-a9cc-6ae225f227a9 tempest-VolumesListAdminTestJSON-220473751 None] Acquiring lock "cinder-3e34e76d-bd88-437a-b73b-0f28954e160e-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c35b5b3f-42c2-4ed4-a9cc-6ae225f227a9 tempest-VolumesListAdminTestJSON-220473751 None] Lock "cinder-3e34e76d-bd88-437a-b73b-0f28954e160e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c35b5b3f-42c2-4ed4-a9cc-6ae225f227a9 tempest-VolumesListAdminTestJSON-220473751 None] Acquiring lock "cinder-quobyte-3e34e76d-bd88-437a-b73b-0f28954e160e" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c35b5b3f-42c2-4ed4-a9cc-6ae225f227a9 tempest-VolumesListAdminTestJSON-220473751 None] Lock "cinder-quobyte-3e34e76d-bd88-437a-b73b-0f28954e160e" acquired by "delete_volume" :: waited 0.057s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-12110da2-4225-42cd-9fbb-85b7863ac2f0 tempest-VolumesListAdminTestJSON-1803217355 None] Acquiring lock "cinder-3face510-f909-49a2-8138-2fecc9d43086-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:36 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[171f93ec-35e1-4453-b890-2aff224d50ae]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c35b5b3f-42c2-4ed4-a9cc-6ae225f227a9 tempest-VolumesListAdminTestJSON-220473751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3e34e76d-bd88-437a-b73b-0f28954e160e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-12110da2-4225-42cd-9fbb-85b7863ac2f0 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "cinder-3face510-f909-49a2-8138-2fecc9d43086-delete_volume" acquired by "delete_volume" :: waited 0.137s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-12110da2-4225-42cd-9fbb-85b7863ac2f0 tempest-VolumesListAdminTestJSON-1803217355 None] Acquiring lock "cinder-quobyte-3face510-f909-49a2-8138-2fecc9d43086" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-12110da2-4225-42cd-9fbb-85b7863ac2f0 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "cinder-quobyte-3face510-f909-49a2-8138-2fecc9d43086" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:36 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d67308-f739-49f5-ae14-d125c608615f]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-12110da2-4225-42cd-9fbb-85b7863ac2f0 tempest-VolumesListAdminTestJSON-1803217355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3face510-f909-49a2-8138-2fecc9d43086 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:36 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3e34e76d-bd88-437a-b73b-0f28954e160e Feb 27 02:05:36 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:37 devstack sudo[86986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3face510-f909-49a2-8138-2fecc9d43086 Feb 27 02:05:37 devstack sudo[86986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:37 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c35b5b3f-42c2-4ed4-a9cc-6ae225f227a9 tempest-VolumesListAdminTestJSON-220473751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3e34e76d-bd88-437a-b73b-0f28954e160e" returned: 0 in 1.294s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c35b5b3f-42c2-4ed4-a9cc-6ae225f227a9 tempest-VolumesListAdminTestJSON-220473751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3e34e76d-bd88-437a-b73b-0f28954e160e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:37 devstack sudo[87031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3e34e76d-bd88-437a-b73b-0f28954e160e Feb 27 02:05:37 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:38 devstack sudo[86986]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-12110da2-4225-42cd-9fbb-85b7863ac2f0 tempest-VolumesListAdminTestJSON-1803217355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3face510-f909-49a2-8138-2fecc9d43086" returned: 0 in 1.223s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-12110da2-4225-42cd-9fbb-85b7863ac2f0 tempest-VolumesListAdminTestJSON-1803217355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3face510-f909-49a2-8138-2fecc9d43086 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:38 devstack sudo[87040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3face510-f909-49a2-8138-2fecc9d43086 Feb 27 02:05:38 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:39 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-12110da2-4225-42cd-9fbb-85b7863ac2f0 tempest-VolumesListAdminTestJSON-1803217355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3face510-f909-49a2-8138-2fecc9d43086" returned: 0 in 1.235s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-12110da2-4225-42cd-9fbb-85b7863ac2f0 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "cinder-quobyte-3face510-f909-49a2-8138-2fecc9d43086" released by "delete_volume" :: held 2.518s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:39 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-12110da2-4225-42cd-9fbb-85b7863ac2f0 tempest-VolumesListAdminTestJSON-1803217355 None] Created reservations ['d597126e-f187-431b-8fe2-44007de54dbd', '2627458e-e1fc-4fe4-9c2a-a3c669f24059', '39218244-5ffd-4c94-8791-08e8701c80ba', 'f940c02a-bbea-4d7a-9a1d-036bac15fc4d'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-12110da2-4225-42cd-9fbb-85b7863ac2f0 tempest-VolumesListAdminTestJSON-1803217355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-12110da2-4225-42cd-9fbb-85b7863ac2f0 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-12110da2-4225-42cd-9fbb-85b7863ac2f0 tempest-VolumesListAdminTestJSON-1803217355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-12110da2-4225-42cd-9fbb-85b7863ac2f0 tempest-VolumesListAdminTestJSON-1803217355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-12110da2-4225-42cd-9fbb-85b7863ac2f0 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-12110da2-4225-42cd-9fbb-85b7863ac2f0 tempest-VolumesListAdminTestJSON-1803217355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:39 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c35b5b3f-42c2-4ed4-a9cc-6ae225f227a9 tempest-VolumesListAdminTestJSON-220473751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3e34e76d-bd88-437a-b73b-0f28954e160e" returned: 0 in 1.815s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c35b5b3f-42c2-4ed4-a9cc-6ae225f227a9 tempest-VolumesListAdminTestJSON-220473751 None] Lock "cinder-quobyte-3e34e76d-bd88-437a-b73b-0f28954e160e" released by "delete_volume" :: held 3.261s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:39 devstack sudo[87046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:05:39 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:39 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-c35b5b3f-42c2-4ed4-a9cc-6ae225f227a9 tempest-VolumesListAdminTestJSON-220473751 None] Created reservations ['88c842c4-88bd-491e-9b9c-c927cbbee214', 'af9e13d8-c236-44d8-b340-a1d30979889f', 'ed3d945c-9905-4860-8511-81cccc9af115', 'a1e50f5f-bb15-4ac3-b67a-0b042e988ff8'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c35b5b3f-42c2-4ed4-a9cc-6ae225f227a9 tempest-VolumesListAdminTestJSON-220473751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c35b5b3f-42c2-4ed4-a9cc-6ae225f227a9 tempest-VolumesListAdminTestJSON-220473751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c35b5b3f-42c2-4ed4-a9cc-6ae225f227a9 tempest-VolumesListAdminTestJSON-220473751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c35b5b3f-42c2-4ed4-a9cc-6ae225f227a9 tempest-VolumesListAdminTestJSON-220473751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c35b5b3f-42c2-4ed4-a9cc-6ae225f227a9 tempest-VolumesListAdminTestJSON-220473751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c35b5b3f-42c2-4ed4-a9cc-6ae225f227a9 tempest-VolumesListAdminTestJSON-220473751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:40 devstack sudo[87049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:05:40 devstack sudo[87049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-fbc30fc0-6041-4ea5-b661-d8c86488c683 tempest-VolumesListAdminTestJSON-1803217355 None] Acquiring lock "cinder-211f7a57-250d-45b3-9376-b2bc0a02c63d-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-fbc30fc0-6041-4ea5-b661-d8c86488c683 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "cinder-211f7a57-250d-45b3-9376-b2bc0a02c63d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-fbc30fc0-6041-4ea5-b661-d8c86488c683 tempest-VolumesListAdminTestJSON-1803217355 None] Acquiring lock "cinder-quobyte-211f7a57-250d-45b3-9376-b2bc0a02c63d" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-fbc30fc0-6041-4ea5-b661-d8c86488c683 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "cinder-quobyte-211f7a57-250d-45b3-9376-b2bc0a02c63d" acquired by "delete_volume" :: waited 0.048s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:40 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7eee669-ea7c-4d6f-a22e-8a52a4ae5ca8]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-fbc30fc0-6041-4ea5-b661-d8c86488c683 tempest-VolumesListAdminTestJSON-1803217355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-211f7a57-250d-45b3-9376-b2bc0a02c63d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:41 devstack sudo[87052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-211f7a57-250d-45b3-9376-b2bc0a02c63d Feb 27 02:05:41 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Flow 'volume_create_manager' (a073e23a-9ebd-4a51-a375-151ceda403f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (238ca6a9-b976-4722-a657-ab85caf3e5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (238ca6a9-b976-4722-a657-ab85caf3e5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-125515373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5d350d-a3dd-421c-8064-ff2dfcdcf25f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43968f761d94193a66baec8a7673d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:41Z,use_quota=True,user_id='2eb36ba0b2014b019009dd6339a4d0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875992a7-9597-4538-9063-55ced75e4ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875992a7-9597-4538-9063-55ced75e4ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56622051-f039-4234-a000-af438b1c95db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56622051-f039-4234-a000-af438b1c95db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb5d350d-a3dd-421c-8064-ff2dfcdcf25f', 'volume_name': 'volume-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b257a5e4-89e6-497f-9549-17a0a6b6a92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b257a5e4-89e6-497f-9549-17a0a6b6a92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0119a2b0-510d-435d-b1ec-a20217909ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:41 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Volume eb5d350d-a3dd-421c-8064-ff2dfcdcf25f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f', 'volume_size': 1} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-125515373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5d350d-a3dd-421c-8064-ff2dfcdcf25f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43968f761d94193a66baec8a7673d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:41Z,use_quota=True,user_id='2eb36ba0b2014b019009dd6339a4d0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Creating volume eb5d350d-a3dd-421c-8064-ff2dfcdcf25f {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:41 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:41 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:41 devstack sudo[87049]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-12110da2-4225-42cd-9fbb-85b7863ac2f0 tempest-VolumesListAdminTestJSON-1803217355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 2.280s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:41 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-12110da2-4225-42cd-9fbb-85b7863ac2f0 tempest-VolumesListAdminTestJSON-1803217355 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:41 devstack sudo[87056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f 1073741824 Feb 27 02:05:41 devstack sudo[87056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c35b5b3f-42c2-4ed4-a9cc-6ae225f227a9 tempest-VolumesListAdminTestJSON-220473751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 1.873s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:42 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-c35b5b3f-42c2-4ed4-a9cc-6ae225f227a9 tempest-VolumesListAdminTestJSON-220473751 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:42 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-12110da2-4225-42cd-9fbb-85b7863ac2f0 tempest-VolumesListAdminTestJSON-1803217355 None] Deleted volume successfully. Feb 27 02:05:42 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c35b5b3f-42c2-4ed4-a9cc-6ae225f227a9 tempest-VolumesListAdminTestJSON-220473751 None] Deleted volume successfully. Feb 27 02:05:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-12110da2-4225-42cd-9fbb-85b7863ac2f0 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "cinder-3face510-f909-49a2-8138-2fecc9d43086-delete_volume" released by "delete_volume" :: held 5.358s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c35b5b3f-42c2-4ed4-a9cc-6ae225f227a9 tempest-VolumesListAdminTestJSON-220473751 None] Lock "cinder-3e34e76d-bd88-437a-b73b-0f28954e160e-delete_volume" released by "delete_volume" :: held 5.719s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:42 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-fbc30fc0-6041-4ea5-b661-d8c86488c683 tempest-VolumesListAdminTestJSON-1803217355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-211f7a57-250d-45b3-9376-b2bc0a02c63d" returned: 0 in 1.689s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-fbc30fc0-6041-4ea5-b661-d8c86488c683 tempest-VolumesListAdminTestJSON-1803217355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-211f7a57-250d-45b3-9376-b2bc0a02c63d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:42 devstack sudo[87061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-211f7a57-250d-45b3-9376-b2bc0a02c63d Feb 27 02:05:42 devstack sudo[87061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:43 devstack sudo[87056]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f 1073741824" returned: 0 in 1.339s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:43 devstack sudo[87089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f Feb 27 02:05:43 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:43 devstack sudo[87061]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-fbc30fc0-6041-4ea5-b661-d8c86488c683 tempest-VolumesListAdminTestJSON-1803217355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-211f7a57-250d-45b3-9376-b2bc0a02c63d" returned: 0 in 0.829s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-fbc30fc0-6041-4ea5-b661-d8c86488c683 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "cinder-quobyte-211f7a57-250d-45b3-9376-b2bc0a02c63d" released by "delete_volume" :: held 2.585s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:43 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-fbc30fc0-6041-4ea5-b661-d8c86488c683 tempest-VolumesListAdminTestJSON-1803217355 None] Created reservations ['8691d182-1ba2-4754-9891-4b85477292ab', '05e12382-7615-43b8-af17-2a14e55ffd49', '57f2e54d-bb76-44fc-abe0-d57c58780cfe', '7314173f-af08-45fe-9efd-83a1ab537bef'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-fbc30fc0-6041-4ea5-b661-d8c86488c683 tempest-VolumesListAdminTestJSON-1803217355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-fbc30fc0-6041-4ea5-b661-d8c86488c683 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-fbc30fc0-6041-4ea5-b661-d8c86488c683 tempest-VolumesListAdminTestJSON-1803217355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-fbc30fc0-6041-4ea5-b661-d8c86488c683 tempest-VolumesListAdminTestJSON-1803217355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-fbc30fc0-6041-4ea5-b661-d8c86488c683 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-fbc30fc0-6041-4ea5-b661-d8c86488c683 tempest-VolumesListAdminTestJSON-1803217355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:43 devstack sudo[87092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:05:43 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:44 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f" returned: 0 in 0.778s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] <== create_volume: return (2174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.177s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0119a2b0-510d-435d-b1ec-a20217909ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d682616-f753-4135-8d6c-7a6ced3fe0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:44 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Volume volume-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f (eb5d350d-a3dd-421c-8064-ff2dfcdcf25f): created successfully Feb 27 02:05:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d682616-f753-4135-8d6c-7a6ced3fe0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Flow 'volume_create_manager' (a073e23a-9ebd-4a51-a375-151ceda403f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:44 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8d28d051-16f0-4385-a79e-a068d90f5a66 tempest-VolumesActionsTest-1774596361 None] Created volume successfully. Feb 27 02:05:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b66bec94-b0dd-4a95-b40a-2ae139f361ea tempest-VolumesListAdminTestJSON-1803217355 None] Acquiring lock "cinder-8300ea2b-5540-43dd-ab92-d613f523b31a-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b66bec94-b0dd-4a95-b40a-2ae139f361ea tempest-VolumesListAdminTestJSON-1803217355 None] Lock "cinder-8300ea2b-5540-43dd-ab92-d613f523b31a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b66bec94-b0dd-4a95-b40a-2ae139f361ea tempest-VolumesListAdminTestJSON-1803217355 None] Acquiring lock "cinder-quobyte-8300ea2b-5540-43dd-ab92-d613f523b31a" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b66bec94-b0dd-4a95-b40a-2ae139f361ea tempest-VolumesListAdminTestJSON-1803217355 None] Lock "cinder-quobyte-8300ea2b-5540-43dd-ab92-d613f523b31a" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:44 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[235e7626-7333-4a1c-85dc-ffaf4e3df809]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b66bec94-b0dd-4a95-b40a-2ae139f361ea tempest-VolumesListAdminTestJSON-1803217355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8300ea2b-5540-43dd-ab92-d613f523b31a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:44 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-fbc30fc0-6041-4ea5-b661-d8c86488c683 tempest-VolumesListAdminTestJSON-1803217355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.727s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:44 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-fbc30fc0-6041-4ea5-b661-d8c86488c683 tempest-VolumesListAdminTestJSON-1803217355 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:44 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-fbc30fc0-6041-4ea5-b661-d8c86488c683 tempest-VolumesListAdminTestJSON-1803217355 None] Deleted volume successfully. Feb 27 02:05:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-fbc30fc0-6041-4ea5-b661-d8c86488c683 tempest-VolumesListAdminTestJSON-1803217355 None] Lock "cinder-211f7a57-250d-45b3-9376-b2bc0a02c63d-delete_volume" released by "delete_volume" :: held 3.836s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:44 devstack sudo[87098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8300ea2b-5540-43dd-ab92-d613f523b31a Feb 27 02:05:44 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ce08a87e-e717-4b2c-9b5b-1271078cfa93 tempest-VolumesActionsTest-1774596361 None] Acquiring lock "cinder-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f" by "attach_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ce08a87e-e717-4b2c-9b5b-1271078cfa93 tempest-VolumesActionsTest-1774596361 None] Lock "cinder-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f" acquired by "attach_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:44 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ce08a87e-e717-4b2c-9b5b-1271078cfa93 tempest-VolumesActionsTest-1774596361 None] Attaching volume eb5d350d-a3dd-421c-8064-ff2dfcdcf25f to instance fcd9cfb9-25a3-4b16-b71d-5642ddcec8fc at mountpoint /dev/vdb on host None. Feb 27 02:05:44 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ce08a87e-e717-4b2c-9b5b-1271078cfa93 tempest-VolumesActionsTest-1774596361 None] Attach volume completed successfully. Feb 27 02:05:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ce08a87e-e717-4b2c-9b5b-1271078cfa93 tempest-VolumesActionsTest-1774596361 None] Lock "cinder-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f" released by "attach_volume" :: held 0.167s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:45 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b66bec94-b0dd-4a95-b40a-2ae139f361ea tempest-VolumesListAdminTestJSON-1803217355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8300ea2b-5540-43dd-ab92-d613f523b31a" returned: 0 in 0.863s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b66bec94-b0dd-4a95-b40a-2ae139f361ea tempest-VolumesListAdminTestJSON-1803217355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8300ea2b-5540-43dd-ab92-d613f523b31a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:45 devstack sudo[87104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8300ea2b-5540-43dd-ab92-d613f523b31a Feb 27 02:05:45 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:45 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-9af2b014-220f-4f24-9ddd-aeaafe400ae8 tempest-VolumesActionsTest-1434842878 None] Terminate volume connection completed successfully. Feb 27 02:05:45 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b66bec94-b0dd-4a95-b40a-2ae139f361ea tempest-VolumesListAdminTestJSON-1803217355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8300ea2b-5540-43dd-ab92-d613f523b31a" returned: 0 in 0.701s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:45 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b66bec94-b0dd-4a95-b40a-2ae139f361ea tempest-VolumesListAdminTestJSON-1803217355 None] Lock "cinder-quobyte-8300ea2b-5540-43dd-ab92-d613f523b31a" released by "delete_volume" :: held 1.615s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:45 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-b66bec94-b0dd-4a95-b40a-2ae139f361ea tempest-VolumesListAdminTestJSON-1803217355 None] Created reservations ['23b2bc8e-98db-486c-8db3-65ed038f2604', '7c74f9e7-ccd2-4915-95ee-75e11a25dcab', 'deb5bc81-8575-4266-aa68-4051a4ce2e84', '5aaed97f-3c51-4865-ab0b-9989899a49bb'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b66bec94-b0dd-4a95-b40a-2ae139f361ea tempest-VolumesListAdminTestJSON-1803217355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b66bec94-b0dd-4a95-b40a-2ae139f361ea tempest-VolumesListAdminTestJSON-1803217355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b66bec94-b0dd-4a95-b40a-2ae139f361ea tempest-VolumesListAdminTestJSON-1803217355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b66bec94-b0dd-4a95-b40a-2ae139f361ea tempest-VolumesListAdminTestJSON-1803217355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b66bec94-b0dd-4a95-b40a-2ae139f361ea tempest-VolumesListAdminTestJSON-1803217355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b66bec94-b0dd-4a95-b40a-2ae139f361ea tempest-VolumesListAdminTestJSON-1803217355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:46 devstack sudo[87107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:05:46 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:46 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-f3ecec35-5b82-4e30-9522-89248c9d70ed tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Terminate volume connection completed successfully. Feb 27 02:05:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-f3ecec35-5b82-4e30-9522-89248c9d70ed tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Deleting attachment 0eb8db16-ab15-4e26-a00a-749dedf6acad. {{(pid=83167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 02:05:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9af2b014-220f-4f24-9ddd-aeaafe400ae8 tempest-VolumesActionsTest-1434842878 None] Acquiring lock "cinder-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f-detach_volume" by "detach_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9af2b014-220f-4f24-9ddd-aeaafe400ae8 tempest-VolumesActionsTest-1434842878 None] Lock "cinder-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:46 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-9af2b014-220f-4f24-9ddd-aeaafe400ae8 tempest-VolumesActionsTest-1434842878 None] Detaching volume eb5d350d-a3dd-421c-8064-ff2dfcdcf25f from instance fcd9cfb9-25a3-4b16-b71d-5642ddcec8fc. Feb 27 02:05:46 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-9af2b014-220f-4f24-9ddd-aeaafe400ae8 tempest-VolumesActionsTest-1434842878 None] Detach volume completed successfully. Feb 27 02:05:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9af2b014-220f-4f24-9ddd-aeaafe400ae8 tempest-VolumesActionsTest-1434842878 None] Lock "cinder-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f-detach_volume" released by "detach_volume" :: held 0.055s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:46 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b66bec94-b0dd-4a95-b40a-2ae139f361ea tempest-VolumesListAdminTestJSON-1803217355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.529s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:46 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-b66bec94-b0dd-4a95-b40a-2ae139f361ea tempest-VolumesListAdminTestJSON-1803217355 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:46 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b66bec94-b0dd-4a95-b40a-2ae139f361ea tempest-VolumesListAdminTestJSON-1803217355 None] Deleted volume successfully. Feb 27 02:05:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b66bec94-b0dd-4a95-b40a-2ae139f361ea tempest-VolumesListAdminTestJSON-1803217355 None] Lock "cinder-8300ea2b-5540-43dd-ab92-d613f523b31a-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Acquiring lock "cinder-97fe86c9-8d57-402f-8a62-9ad5a7cbf469-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "cinder-97fe86c9-8d57-402f-8a62-9ad5a7cbf469-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Acquiring lock "cinder-quobyte-97fe86c9-8d57-402f-8a62-9ad5a7cbf469" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "cinder-quobyte-97fe86c9-8d57-402f-8a62-9ad5a7cbf469" acquired by "delete_volume" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c705dc81-7627-41bc-ae3b-919774d27bba]: (4, 'raw') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-80779762-f4bf-45ca-9e78-dda7b9f1bbe9 tempest-VolumesActionsTest-1774596361 None] Acquiring lock "cinder-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f-detach_volume" by "detach_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-80779762-f4bf-45ca-9e78-dda7b9f1bbe9 tempest-VolumesActionsTest-1774596361 None] Lock "cinder-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:47 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-80779762-f4bf-45ca-9e78-dda7b9f1bbe9 tempest-VolumesActionsTest-1774596361 None] Volume detach called, but volume not attached. Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-80779762-f4bf-45ca-9e78-dda7b9f1bbe9 tempest-VolumesActionsTest-1774596361 None] Lock "cinder-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:47 devstack sudo[87110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 Feb 27 02:05:47 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Flow 'volume_create_manager' (8fd6fe5f-51b0-4f87-9687-5a1a64e6e07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c74bb2c-9ce0-4992-be88-97db3d35aed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c74bb2c-9ce0-4992-be88-97db3d35aed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1147848863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd85e85c-782f-4f49-a5f0-2dc49fee894c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9185e7b6a5e4bb9a8174926da67356a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:47Z,use_quota=True,user_id='758ec923bd3e4a87b2ec97a8c17738c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5f0465-780e-41ab-9a12-3400821fe4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5f0465-780e-41ab-9a12-3400821fe4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7223a19-8c6d-4de7-b074-444260bb92ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7223a19-8c6d-4de7-b074-444260bb92ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd85e85c-782f-4f49-a5f0-2dc49fee894c', 'volume_name': 'volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630e06ea-533f-47ed-b825-286e5f313a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630e06ea-533f-47ed-b825-286e5f313a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1400015e-d608-463b-bac5-c098fec92d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:47 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Volume fd85e85c-782f-4f49-a5f0-2dc49fee894c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c', 'volume_size': 1} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1147848863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd85e85c-782f-4f49-a5f0-2dc49fee894c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9185e7b6a5e4bb9a8174926da67356a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:47Z,use_quota=True,user_id='758ec923bd3e4a87b2ec97a8c17738c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Creating volume fd85e85c-782f-4f49-a5f0-2dc49fee894c {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:47 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:47 devstack sudo[87112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c 1073741824 Feb 27 02:05:47 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef5e977b-c060-416c-865c-20ca4746b44a tempest-VolumesActionsTest-1774596361 None] Acquiring lock "cinder-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef5e977b-c060-416c-865c-20ca4746b44a tempest-VolumesActionsTest-1774596361 None] Lock "cinder-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef5e977b-c060-416c-865c-20ca4746b44a tempest-VolumesActionsTest-1774596361 None] Acquiring lock "cinder-quobyte-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef5e977b-c060-416c-865c-20ca4746b44a tempest-VolumesActionsTest-1774596361 None] Lock "cinder-quobyte-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f" acquired by "delete_volume" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:48 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb3bbd2-9857-49b8-9154-f6d39bb64b29]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef5e977b-c060-416c-865c-20ca4746b44a tempest-VolumesActionsTest-1774596361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:48 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469" returned: 0 in 1.009s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:48 devstack sudo[87117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f Feb 27 02:05:48 devstack sudo[87117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:48 devstack sudo[87118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 Feb 27 02:05:48 devstack sudo[87118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:48 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c 1073741824" returned: 0 in 1.103s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:48 devstack sudo[87124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c Feb 27 02:05:48 devstack sudo[87124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:49 devstack sudo[87117]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef5e977b-c060-416c-865c-20ca4746b44a tempest-VolumesActionsTest-1774596361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f" returned: 0 in 1.040s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef5e977b-c060-416c-865c-20ca4746b44a tempest-VolumesActionsTest-1774596361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:49 devstack sudo[87118]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469" returned: 1 in 0.973s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:05:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:49 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f Feb 27 02:05:49 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:49 devstack sudo[87134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469 Feb 27 02:05:49 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:49 devstack sudo[87124]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c" returned: 0 in 1.101s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] <== create_volume: return (2297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.299s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1400015e-d608-463b-bac5-c098fec92d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (babadf76-1ac0-4a5a-8d32-71a9bb2a29d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:49 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=100,cinder:UPDATE=144,cinder:INSERT=29,cinder:DELETE=9 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:05:49 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Volume volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c (fd85e85c-782f-4f49-a5f0-2dc49fee894c): created successfully Feb 27 02:05:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (babadf76-1ac0-4a5a-8d32-71a9bb2a29d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:49 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:49 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Flow 'volume_create_manager' (8fd6fe5f-51b0-4f87-9687-5a1a64e6e07b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:49 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:UPDATE=101,cinder:DELETE=12,cinder:SELECT=93,cinder:INSERT=38 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:05:49 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-99814c79-7d6b-42ba-8d8b-c71b5f3eec80 tempest-VolumesActionsTest-281576991 None] Created volume successfully. Feb 27 02:05:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef5e977b-c060-416c-865c-20ca4746b44a tempest-VolumesActionsTest-1774596361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f" returned: 0 in 0.902s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef5e977b-c060-416c-865c-20ca4746b44a tempest-VolumesActionsTest-1774596361 None] Lock "cinder-quobyte-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f" released by "delete_volume" :: held 1.995s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:50 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97fe86c9-8d57-402f-8a62-9ad5a7cbf469" returned: 0 in 0.933s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "cinder-quobyte-97fe86c9-8d57-402f-8a62-9ad5a7cbf469" released by "delete_volume" :: held 3.008s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:50 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ef5e977b-c060-416c-865c-20ca4746b44a tempest-VolumesActionsTest-1774596361 None] Created reservations ['3ec11c54-1580-4caf-9864-5a6a30c5156d', '1456e9b8-453e-40c0-8ba0-8b5f39643fa6', '3dfe0d9a-0f01-45b4-a3aa-42f475f66f50', '0599455f-6d50-444a-9c17-14a27bc00c22'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:50 devstack cinder-volume[83167]: DEBUG cinder.quota [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Created reservations ['824e43e6-6384-4737-9964-ec2f64c46f7c', '3752fad6-f6a0-429d-bae1-a967afcd89a1', '8e58231a-25e8-475b-b2f9-b1720a678aa4', 'a088db7e-ad64-4b48-be7e-aeafa58869fa'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ef5e977b-c060-416c-865c-20ca4746b44a tempest-VolumesActionsTest-1774596361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ef5e977b-c060-416c-865c-20ca4746b44a tempest-VolumesActionsTest-1774596361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ef5e977b-c060-416c-865c-20ca4746b44a tempest-VolumesActionsTest-1774596361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ef5e977b-c060-416c-865c-20ca4746b44a tempest-VolumesActionsTest-1774596361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ef5e977b-c060-416c-865c-20ca4746b44a tempest-VolumesActionsTest-1774596361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef5e977b-c060-416c-865c-20ca4746b44a tempest-VolumesActionsTest-1774596361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:50 devstack sudo[87139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:05:50 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:50 devstack sudo[87140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:05:50 devstack sudo[87140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:51 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef5e977b-c060-416c-865c-20ca4746b44a tempest-VolumesActionsTest-1774596361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.887s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:51 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-ef5e977b-c060-416c-865c-20ca4746b44a tempest-VolumesActionsTest-1774596361 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:51 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ef5e977b-c060-416c-865c-20ca4746b44a tempest-VolumesActionsTest-1774596361 None] Deleted volume successfully. Feb 27 02:05:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef5e977b-c060-416c-865c-20ca4746b44a tempest-VolumesActionsTest-1774596361 None] Lock "cinder-eb5d350d-a3dd-421c-8064-ff2dfcdcf25f-delete_volume" released by "delete_volume" :: held 3.174s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:51 devstack sudo[87140]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 1.088s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:51 devstack cinder-volume[83167]: DEBUG cinder.manager [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:51 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Deleted volume successfully. Feb 27 02:05:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-0fc85820-acd5-4eb6-8480-2151f1b3f2a0 req-8cc38136-a553-4568-a1e8-a1d1e03b2f4b tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "cinder-97fe86c9-8d57-402f-8a62-9ad5a7cbf469-delete_volume" released by "delete_volume" :: held 4.369s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Flow 'volume_create_manager' (6865666e-c27d-40c4-b209-672f79d2ab55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acd7abbb-be43-4546-b4ea-68cd654058c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acd7abbb-be43-4546-b4ea-68cd654058c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1350615936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813eca30-0010-4a61-a3eb-5eb98e63bee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55100040a4064a61be4a6d05b49af72c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:52Z,use_quota=True,user_id='319d460e07394afb9e5492ee1aa055d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d9e9dc-47cb-4fc5-a6a6-dec9ad282f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d9e9dc-47cb-4fc5-a6a6-dec9ad282f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29308b31-5eb6-470f-8909-37aa5f995292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29308b31-5eb6-470f-8909-37aa5f995292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '813eca30-0010-4a61-a3eb-5eb98e63bee0', 'volume_name': 'volume-813eca30-0010-4a61-a3eb-5eb98e63bee0', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6e0b51-05e1-4c57-a760-d57bffd39b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6e0b51-05e1-4c57-a760-d57bffd39b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9faeb861-b1d3-4632-b95d-5e806f6c0217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:52 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Volume 813eca30-0010-4a61-a3eb-5eb98e63bee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-813eca30-0010-4a61-a3eb-5eb98e63bee0', 'volume_size': 1} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1350615936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813eca30-0010-4a61-a3eb-5eb98e63bee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55100040a4064a61be4a6d05b49af72c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:52Z,use_quota=True,user_id='319d460e07394afb9e5492ee1aa055d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Creating volume 813eca30-0010-4a61-a3eb-5eb98e63bee0 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:52 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:52 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0 1073741824 Feb 27 02:05:52 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:52 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0 1073741824" returned: 0 in 0.826s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:52 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0 Feb 27 02:05:52 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:53 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0" returned: 0 in 0.522s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9faeb861-b1d3-4632-b95d-5e806f6c0217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-813eca30-0010-4a61-a3eb-5eb98e63bee0', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd51d0f-ceec-4d11-af27-232bd64d3484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:53 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Volume volume-813eca30-0010-4a61-a3eb-5eb98e63bee0 (813eca30-0010-4a61-a3eb-5eb98e63bee0): created successfully Feb 27 02:05:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd51d0f-ceec-4d11-af27-232bd64d3484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:53 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Flow 'volume_create_manager' (6865666e-c27d-40c4-b209-672f79d2ab55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:53 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a1311d74-b696-4e3c-8ad5-7b1778e54469 tempest-SnapshotMetadataTestJSON-1060809874 None] Created volume successfully. Feb 27 02:05:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3c3864f-b769-4ed1-9f68-04271bb05657 tempest-SnapshotMetadataTestJSON-1060809874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3c3864f-b769-4ed1-9f68-04271bb05657 tempest-SnapshotMetadataTestJSON-1060809874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a3c3864f-b769-4ed1-9f68-04271bb05657 tempest-SnapshotMetadataTestJSON-1060809874 None] Creating offline snapshot bac48d76-042f-41ee-9e9c-3a84e0b7135b of volume 813eca30-0010-4a61-a3eb-5eb98e63bee0 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:05:54 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[890bc055-9e52-4cb0-b49c-a3de37d8841b]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3c3864f-b769-4ed1-9f68-04271bb05657 tempest-SnapshotMetadataTestJSON-1060809874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:54 devstack sudo[87223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0 Feb 27 02:05:54 devstack sudo[87223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:54 devstack sudo[87223]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3c3864f-b769-4ed1-9f68-04271bb05657 tempest-SnapshotMetadataTestJSON-1060809874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0" returned: 0 in 0.506s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3c3864f-b769-4ed1-9f68-04271bb05657 tempest-SnapshotMetadataTestJSON-1060809874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.bac48d76-042f-41ee-9e9c-3a84e0b7135b 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:54 devstack sudo[87228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.bac48d76-042f-41ee-9e9c-3a84e0b7135b 1G Feb 27 02:05:54 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:55 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3c3864f-b769-4ed1-9f68-04271bb05657 tempest-SnapshotMetadataTestJSON-1060809874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.bac48d76-042f-41ee-9e9c-3a84e0b7135b 1G" returned: 0 in 0.503s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3c3864f-b769-4ed1-9f68-04271bb05657 tempest-SnapshotMetadataTestJSON-1060809874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-813eca30-0010-4a61-a3eb-5eb98e63bee0 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.bac48d76-042f-41ee-9e9c-3a84e0b7135b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:55 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-813eca30-0010-4a61-a3eb-5eb98e63bee0 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.bac48d76-042f-41ee-9e9c-3a84e0b7135b Feb 27 02:05:55 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:55 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3c3864f-b769-4ed1-9f68-04271bb05657 tempest-SnapshotMetadataTestJSON-1060809874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-813eca30-0010-4a61-a3eb-5eb98e63bee0 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.bac48d76-042f-41ee-9e9c-3a84e0b7135b" returned: 0 in 0.445s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:55 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-a3c3864f-b769-4ed1-9f68-04271bb05657 tempest-SnapshotMetadataTestJSON-1060809874 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.bac48d76-042f-41ee-9e9c-3a84e0b7135b is being set with open permissions: ugo+rw Feb 27 02:05:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3c3864f-b769-4ed1-9f68-04271bb05657 tempest-SnapshotMetadataTestJSON-1060809874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.bac48d76-042f-41ee-9e9c-3a84e0b7135b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:55 devstack sudo[87238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.bac48d76-042f-41ee-9e9c-3a84e0b7135b Feb 27 02:05:55 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:56 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3c3864f-b769-4ed1-9f68-04271bb05657 tempest-SnapshotMetadataTestJSON-1060809874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.bac48d76-042f-41ee-9e9c-3a84e0b7135b" returned: 0 in 0.446s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3c3864f-b769-4ed1-9f68-04271bb05657 tempest-SnapshotMetadataTestJSON-1060809874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:56 devstack sudo[87241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.info Feb 27 02:05:56 devstack sudo[87241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:56 devstack sudo[87241]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3c3864f-b769-4ed1-9f68-04271bb05657 tempest-SnapshotMetadataTestJSON-1060809874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.info" returned: 0 in 0.498s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:56 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-a3c3864f-b769-4ed1-9f68-04271bb05657 tempest-SnapshotMetadataTestJSON-1060809874 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.info is being set with open permissions: ugo+rw Feb 27 02:05:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3c3864f-b769-4ed1-9f68-04271bb05657 tempest-SnapshotMetadataTestJSON-1060809874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:56 devstack sudo[87244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.info Feb 27 02:05:56 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:57 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3c3864f-b769-4ed1-9f68-04271bb05657 tempest-SnapshotMetadataTestJSON-1060809874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.info" returned: 0 in 0.524s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3c3864f-b769-4ed1-9f68-04271bb05657 tempest-SnapshotMetadataTestJSON-1060809874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.982s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:57 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a3c3864f-b769-4ed1-9f68-04271bb05657 tempest-SnapshotMetadataTestJSON-1060809874 None] Create snapshot completed successfully Feb 27 02:05:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] Acquiring lock "cinder-bac48d76-042f-41ee-9e9c-3a84e0b7135b-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] Lock "cinder-bac48d76-042f-41ee-9e9c-3a84e0b7135b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] Acquiring lock "cinder-quobyte-813eca30-0010-4a61-a3eb-5eb98e63bee0" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] Lock "cinder-quobyte-813eca30-0010-4a61-a3eb-5eb98e63bee0" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] Acquiring lock "cinder-quobyte-bac48d76-042f-41ee-9e9c-3a84e0b7135b" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] Lock "cinder-quobyte-bac48d76-042f-41ee-9e9c-3a84e0b7135b" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] Deleting offline snapshot bac48d76-042f-41ee-9e9c-3a84e0b7135b of volume 813eca30-0010-4a61-a3eb-5eb98e63bee0 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:05:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] snapshot_file for this snap is: volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.bac48d76-042f-41ee-9e9c-3a84e0b7135b {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:05:58 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02567ce-2955-4bd3-8633-869c5c987f2e]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.bac48d76-042f-41ee-9e9c-3a84e0b7135b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:58 devstack sudo[87248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.bac48d76-042f-41ee-9e9c-3a84e0b7135b Feb 27 02:05:58 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:58 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.bac48d76-042f-41ee-9e9c-3a84e0b7135b" returned: 0 in 0.655s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-813eca30-0010-4a61-a3eb-5eb98e63bee0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:58 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[246307b8-cb2d-467d-8360-9d3bb4e79171]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:58 devstack sudo[87264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0 Feb 27 02:05:58 devstack sudo[87264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:59 devstack sudo[87264]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0" returned: 0 in 0.709s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.bac48d76-042f-41ee-9e9c-3a84e0b7135b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:59 devstack sudo[87280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.bac48d76-042f-41ee-9e9c-3a84e0b7135b Feb 27 02:05:59 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Flow 'volume_create_manager' (bf67c366-7847-466b-8597-8d8496ed642b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6f15f3-f923-4582-8c41-9776f98dc034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6f15f3-f923-4582-8c41-9776f98dc034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1024747270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94614f3-64b1-423e-bcab-b15693e18a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43968f761d94193a66baec8a7673d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:00Z,use_quota=True,user_id='2eb36ba0b2014b019009dd6339a4d0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb849f6-2698-4821-a7f6-289bd437eaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb849f6-2698-4821-a7f6-289bd437eaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f35f031-0766-4ad1-b4f0-f1539f823ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f35f031-0766-4ad1-b4f0-f1539f823ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a94614f3-64b1-423e-bcab-b15693e18a11', 'volume_name': 'volume-a94614f3-64b1-423e-bcab-b15693e18a11', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3989b755-6ace-4866-8a31-60a7e35c539e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3989b755-6ace-4866-8a31-60a7e35c539e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a8b7b5-2d12-4141-ac93-cdc5b2bcf4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:59 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Volume a94614f3-64b1-423e-bcab-b15693e18a11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a94614f3-64b1-423e-bcab-b15693e18a11', 'volume_size': 1} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1024747270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94614f3-64b1-423e-bcab-b15693e18a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43968f761d94193a66baec8a7673d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:00Z,use_quota=True,user_id='2eb36ba0b2014b019009dd6339a4d0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Creating volume a94614f3-64b1-423e-bcab-b15693e18a11 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:59 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:05:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a94614f3-64b1-423e-bcab-b15693e18a11 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:59 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a94614f3-64b1-423e-bcab-b15693e18a11 1073741824 Feb 27 02:05:59 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:00 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.bac48d76-042f-41ee-9e9c-3a84e0b7135b" returned: 0 in 0.871s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.bac48d76-042f-41ee-9e9c-3a84e0b7135b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:00 devstack sudo[87310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.bac48d76-042f-41ee-9e9c-3a84e0b7135b Feb 27 02:06:00 devstack sudo[87310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:00 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a94614f3-64b1-423e-bcab-b15693e18a11 1073741824" returned: 0 in 1.016s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a94614f3-64b1-423e-bcab-b15693e18a11 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:00 devstack sudo[87316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a94614f3-64b1-423e-bcab-b15693e18a11 Feb 27 02:06:00 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:00 devstack sudo[87310]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0.bac48d76-042f-41ee-9e9c-3a84e0b7135b" returned: 0 in 0.628s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] Lock "cinder-quobyte-bac48d76-042f-41ee-9e9c-3a84e0b7135b" released by "_delete_snapshot" :: held 2.967s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] Lock "cinder-quobyte-813eca30-0010-4a61-a3eb-5eb98e63bee0" released by "delete_snapshot" :: held 3.001s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] Created reservations ['1290469a-c84b-42a9-bdd2-2fe7b605f6ee', '6d150197-088e-4e2d-a702-3208f1e80db4', 'e0b53da3-f0e8-4dca-8431-0983824cc77f', '96c9e02d-23e0-4d63-bede-80b8c4a4713f'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:01 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] Delete snapshot completed successfully. Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2d562c4a-1712-43b0-8a71-ac73f7724a04 tempest-SnapshotMetadataTestJSON-1060809874 None] Lock "cinder-bac48d76-042f-41ee-9e9c-3a84e0b7135b-delete_snapshot" released by "delete_snapshot" :: held 3.139s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ac08ef49-045e-425d-bf70-f8f0541ea554 tempest-SnapshotMetadataTestJSON-1060809874 None] Acquiring lock "cinder-813eca30-0010-4a61-a3eb-5eb98e63bee0-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ac08ef49-045e-425d-bf70-f8f0541ea554 tempest-SnapshotMetadataTestJSON-1060809874 None] Lock "cinder-813eca30-0010-4a61-a3eb-5eb98e63bee0-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ac08ef49-045e-425d-bf70-f8f0541ea554 tempest-SnapshotMetadataTestJSON-1060809874 None] Acquiring lock "cinder-quobyte-813eca30-0010-4a61-a3eb-5eb98e63bee0" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:01 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ac08ef49-045e-425d-bf70-f8f0541ea554 tempest-SnapshotMetadataTestJSON-1060809874 None] Lock "cinder-quobyte-813eca30-0010-4a61-a3eb-5eb98e63bee0" acquired by "delete_volume" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a94614f3-64b1-423e-bcab-b15693e18a11" returned: 0 in 0.677s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[09082579-1f55-4f15-92a6-6ed48143e84e]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ac08ef49-045e-425d-bf70-f8f0541ea554 tempest-SnapshotMetadataTestJSON-1060809874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a8b7b5-2d12-4141-ac93-cdc5b2bcf4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a94614f3-64b1-423e-bcab-b15693e18a11', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4181c1-74fe-4e67-bafe-3cd4e01884ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:01 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Volume volume-a94614f3-64b1-423e-bcab-b15693e18a11 (a94614f3-64b1-423e-bcab-b15693e18a11): created successfully Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4181c1-74fe-4e67-bafe-3cd4e01884ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Flow 'volume_create_manager' (bf67c366-7847-466b-8597-8d8496ed642b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:01 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-cc463f86-4af7-4dbd-bc2b-c0079ff81aae tempest-VolumesActionsTest-1774596361 None] Created volume successfully. Feb 27 02:06:01 devstack sudo[87321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0 Feb 27 02:06:01 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3b65443d-6aaf-49ac-8376-c86abe3ca61d tempest-VolumesActionsTest-1434842878 None] Acquiring lock "cinder-a94614f3-64b1-423e-bcab-b15693e18a11-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3b65443d-6aaf-49ac-8376-c86abe3ca61d tempest-VolumesActionsTest-1434842878 None] Lock "cinder-a94614f3-64b1-423e-bcab-b15693e18a11-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3b65443d-6aaf-49ac-8376-c86abe3ca61d tempest-VolumesActionsTest-1434842878 None] Acquiring lock "cinder-quobyte-a94614f3-64b1-423e-bcab-b15693e18a11" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3b65443d-6aaf-49ac-8376-c86abe3ca61d tempest-VolumesActionsTest-1434842878 None] Lock "cinder-quobyte-a94614f3-64b1-423e-bcab-b15693e18a11" acquired by "delete_volume" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:01 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbc11c2-21e0-4d31-bb8c-cbeb5f6f8186]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3b65443d-6aaf-49ac-8376-c86abe3ca61d tempest-VolumesActionsTest-1434842878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a94614f3-64b1-423e-bcab-b15693e18a11 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:02 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a94614f3-64b1-423e-bcab-b15693e18a11 Feb 27 02:06:02 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:02 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ac08ef49-045e-425d-bf70-f8f0541ea554 tempest-SnapshotMetadataTestJSON-1060809874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0" returned: 0 in 0.647s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ac08ef49-045e-425d-bf70-f8f0541ea554 tempest-SnapshotMetadataTestJSON-1060809874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:02 devstack sudo[87331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0 Feb 27 02:06:02 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:02 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-d853a369-8469-4487-91dd-55a29c84ff55 req-b7dbd9e8-01e3-44e2-985c-bcce0e46e62f tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Terminate volume connection completed successfully. Feb 27 02:06:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-d853a369-8469-4487-91dd-55a29c84ff55 req-b7dbd9e8-01e3-44e2-985c-bcce0e46e62f tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Deleting attachment bb370515-a693-403c-945e-546b391b3381. {{(pid=83167) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 02:06:02 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3b65443d-6aaf-49ac-8376-c86abe3ca61d tempest-VolumesActionsTest-1434842878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a94614f3-64b1-423e-bcab-b15693e18a11" returned: 0 in 0.563s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3b65443d-6aaf-49ac-8376-c86abe3ca61d tempest-VolumesActionsTest-1434842878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a94614f3-64b1-423e-bcab-b15693e18a11 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:02 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a94614f3-64b1-423e-bcab-b15693e18a11 Feb 27 02:06:02 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:02 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ac08ef49-045e-425d-bf70-f8f0541ea554 tempest-SnapshotMetadataTestJSON-1060809874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-813eca30-0010-4a61-a3eb-5eb98e63bee0" returned: 0 in 0.493s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ac08ef49-045e-425d-bf70-f8f0541ea554 tempest-SnapshotMetadataTestJSON-1060809874 None] Lock "cinder-quobyte-813eca30-0010-4a61-a3eb-5eb98e63bee0" released by "delete_volume" :: held 1.189s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:02 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ac08ef49-045e-425d-bf70-f8f0541ea554 tempest-SnapshotMetadataTestJSON-1060809874 None] Created reservations ['497c75fa-e678-44f2-9bc7-c245a7c748a6', 'dcf59074-1ded-4a1c-80ae-372d278eed6e', '3365b084-1b6f-406d-95f8-d577e5efbbc7', '9e50043b-0dcb-4ee2-9cf2-3ed735d79110'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ac08ef49-045e-425d-bf70-f8f0541ea554 tempest-SnapshotMetadataTestJSON-1060809874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ac08ef49-045e-425d-bf70-f8f0541ea554 tempest-SnapshotMetadataTestJSON-1060809874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ac08ef49-045e-425d-bf70-f8f0541ea554 tempest-SnapshotMetadataTestJSON-1060809874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ac08ef49-045e-425d-bf70-f8f0541ea554 tempest-SnapshotMetadataTestJSON-1060809874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ac08ef49-045e-425d-bf70-f8f0541ea554 tempest-SnapshotMetadataTestJSON-1060809874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ac08ef49-045e-425d-bf70-f8f0541ea554 tempest-SnapshotMetadataTestJSON-1060809874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:02 devstack sudo[87339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:06:02 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:03 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-d853a369-8469-4487-91dd-55a29c84ff55 req-d2e299ca-a82c-406f-8b8c-f0c07e4be022 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Acquiring lock "cinder-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3b65443d-6aaf-49ac-8376-c86abe3ca61d tempest-VolumesActionsTest-1434842878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a94614f3-64b1-423e-bcab-b15693e18a11" returned: 0 in 0.517s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3b65443d-6aaf-49ac-8376-c86abe3ca61d tempest-VolumesActionsTest-1434842878 None] Lock "cinder-quobyte-a94614f3-64b1-423e-bcab-b15693e18a11" released by "delete_volume" :: held 1.112s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-d853a369-8469-4487-91dd-55a29c84ff55 req-d2e299ca-a82c-406f-8b8c-f0c07e4be022 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "cinder-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-d853a369-8469-4487-91dd-55a29c84ff55 req-d2e299ca-a82c-406f-8b8c-f0c07e4be022 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Acquiring lock "cinder-quobyte-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-d853a369-8469-4487-91dd-55a29c84ff55 req-d2e299ca-a82c-406f-8b8c-f0c07e4be022 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "cinder-quobyte-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57" acquired by "delete_volume" :: waited 0.029s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:03 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-3b65443d-6aaf-49ac-8376-c86abe3ca61d tempest-VolumesActionsTest-1434842878 None] Created reservations ['d510f5dc-f281-4e57-bf49-446d9bd7fb1f', '0b1d5b16-9bcd-4e58-9de9-e647b41c2f73', '6b0ac586-007f-4d13-9104-7f77dc7b0f2c', 'b163c388-f0c8-48de-b630-dfa906659060'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:03 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dc420a-1594-4ed2-bb45-786a2d9edeb7]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-d853a369-8469-4487-91dd-55a29c84ff55 req-d2e299ca-a82c-406f-8b8c-f0c07e4be022 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3b65443d-6aaf-49ac-8376-c86abe3ca61d tempest-VolumesActionsTest-1434842878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3b65443d-6aaf-49ac-8376-c86abe3ca61d tempest-VolumesActionsTest-1434842878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3b65443d-6aaf-49ac-8376-c86abe3ca61d tempest-VolumesActionsTest-1434842878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3b65443d-6aaf-49ac-8376-c86abe3ca61d tempest-VolumesActionsTest-1434842878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3b65443d-6aaf-49ac-8376-c86abe3ca61d tempest-VolumesActionsTest-1434842878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3b65443d-6aaf-49ac-8376-c86abe3ca61d tempest-VolumesActionsTest-1434842878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:03 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ac08ef49-045e-425d-bf70-f8f0541ea554 tempest-SnapshotMetadataTestJSON-1060809874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.550s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:03 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-ac08ef49-045e-425d-bf70-f8f0541ea554 tempest-SnapshotMetadataTestJSON-1060809874 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:03 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ac08ef49-045e-425d-bf70-f8f0541ea554 tempest-SnapshotMetadataTestJSON-1060809874 None] Deleted volume successfully. Feb 27 02:06:03 devstack sudo[87343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57 Feb 27 02:06:03 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ac08ef49-045e-425d-bf70-f8f0541ea554 tempest-SnapshotMetadataTestJSON-1060809874 None] Lock "cinder-813eca30-0010-4a61-a3eb-5eb98e63bee0-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:03 devstack sudo[87344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:06:03 devstack sudo[87344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:04 devstack sudo[87344]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3b65443d-6aaf-49ac-8376-c86abe3ca61d tempest-VolumesActionsTest-1434842878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 1.003s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:04 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-3b65443d-6aaf-49ac-8376-c86abe3ca61d tempest-VolumesActionsTest-1434842878 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:04 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3b65443d-6aaf-49ac-8376-c86abe3ca61d tempest-VolumesActionsTest-1434842878 None] Deleted volume successfully. Feb 27 02:06:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3b65443d-6aaf-49ac-8376-c86abe3ca61d tempest-VolumesActionsTest-1434842878 None] Lock "cinder-a94614f3-64b1-423e-bcab-b15693e18a11-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:04 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-d853a369-8469-4487-91dd-55a29c84ff55 req-d2e299ca-a82c-406f-8b8c-f0c07e4be022 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57" returned: 0 in 1.296s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-d853a369-8469-4487-91dd-55a29c84ff55 req-d2e299ca-a82c-406f-8b8c-f0c07e4be022 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:04 devstack sudo[87375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57 Feb 27 02:06:04 devstack sudo[87375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:04 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Flow 'volume_create_manager' (429249a8-8c54-4559-a844-f3c75b760f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6731ea1c-8e6e-4bc9-8e64-00fc9f8965a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6731ea1c-8e6e-4bc9-8e64-00fc9f8965a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-200724791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43968f761d94193a66baec8a7673d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:05Z,use_quota=True,user_id='2eb36ba0b2014b019009dd6339a4d0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7529897e-27b3-484f-b44c-2e5ef396d768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7529897e-27b3-484f-b44c-2e5ef396d768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5530027c-920e-4861-9b4e-40509f5b6837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5530027c-920e-4861-9b4e-40509f5b6837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c', 'volume_name': 'volume-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff021e52-b909-48a6-a6db-bce3640505ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff021e52-b909-48a6-a6db-bce3640505ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9dd983-d4e3-4033-811b-8ec7f12c810e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:05 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Volume 8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c', 'volume_size': 1} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-200724791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43968f761d94193a66baec8a7673d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:05Z,use_quota=True,user_id='2eb36ba0b2014b019009dd6339a4d0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Creating volume 8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:05 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:05 devstack sudo[87378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c 1073741824 Feb 27 02:06:05 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:05 devstack sudo[87375]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-d853a369-8469-4487-91dd-55a29c84ff55 req-d2e299ca-a82c-406f-8b8c-f0c07e4be022 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57" returned: 0 in 0.948s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-d853a369-8469-4487-91dd-55a29c84ff55 req-d2e299ca-a82c-406f-8b8c-f0c07e4be022 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "cinder-quobyte-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57" released by "delete_volume" :: held 2.281s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG cinder.quota [req-d853a369-8469-4487-91dd-55a29c84ff55 req-d2e299ca-a82c-406f-8b8c-f0c07e4be022 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Created reservations ['da588266-142d-4dbb-83eb-e1239e6800bc', 'aaa6706b-1d5a-48fe-8f4e-b16de850a1f3', 'c6b87b6d-0bc2-4d00-9b3c-3641aeeca10f', '2a23a6ea-b342-4ede-998f-5f4259ee1cbc'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-d853a369-8469-4487-91dd-55a29c84ff55 req-d2e299ca-a82c-406f-8b8c-f0c07e4be022 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-d853a369-8469-4487-91dd-55a29c84ff55 req-d2e299ca-a82c-406f-8b8c-f0c07e4be022 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-d853a369-8469-4487-91dd-55a29c84ff55 req-d2e299ca-a82c-406f-8b8c-f0c07e4be022 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-d853a369-8469-4487-91dd-55a29c84ff55 req-d2e299ca-a82c-406f-8b8c-f0c07e4be022 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-d853a369-8469-4487-91dd-55a29c84ff55 req-d2e299ca-a82c-406f-8b8c-f0c07e4be022 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-d853a369-8469-4487-91dd-55a29c84ff55 req-d2e299ca-a82c-406f-8b8c-f0c07e4be022 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:05 devstack sudo[87382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:06:05 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:06 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c 1073741824" returned: 0 in 0.993s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:06 devstack sudo[87387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c Feb 27 02:06:06 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-24aa408b-e6b9-4b20-9fe4-509e0a10e2e3 tempest-VolumesActionsTest-281576991 None] Acquiring lock "cinder-fd85e85c-782f-4f49-a5f0-2dc49fee894c" by "attach_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-24aa408b-e6b9-4b20-9fe4-509e0a10e2e3 tempest-VolumesActionsTest-281576991 None] Lock "cinder-fd85e85c-782f-4f49-a5f0-2dc49fee894c" acquired by "attach_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:06 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-24aa408b-e6b9-4b20-9fe4-509e0a10e2e3 tempest-VolumesActionsTest-281576991 None] Attaching volume fd85e85c-782f-4f49-a5f0-2dc49fee894c to instance 6db91b13-238d-4738-b104-ce45bec9ca8d at mountpoint /dev/vdb on host None. Feb 27 02:06:06 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-24aa408b-e6b9-4b20-9fe4-509e0a10e2e3 tempest-VolumesActionsTest-281576991 None] Attach volume completed successfully. Feb 27 02:06:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-24aa408b-e6b9-4b20-9fe4-509e0a10e2e3 tempest-VolumesActionsTest-281576991 None] Lock "cinder-fd85e85c-782f-4f49-a5f0-2dc49fee894c" released by "attach_volume" :: held 0.157s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:06 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-d853a369-8469-4487-91dd-55a29c84ff55 req-d2e299ca-a82c-406f-8b8c-f0c07e4be022 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.903s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:06 devstack cinder-volume[83167]: DEBUG cinder.manager [req-d853a369-8469-4487-91dd-55a29c84ff55 req-d2e299ca-a82c-406f-8b8c-f0c07e4be022 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:06 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-d853a369-8469-4487-91dd-55a29c84ff55 req-d2e299ca-a82c-406f-8b8c-f0c07e4be022 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Deleted volume successfully. Feb 27 02:06:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-d853a369-8469-4487-91dd-55a29c84ff55 req-d2e299ca-a82c-406f-8b8c-f0c07e4be022 tempest-ServerBootFromVolumeStableRescueTest-1014102458 None] Lock "cinder-6b0b3ee1-c974-4777-a3ee-e2f7129f9c57-delete_volume" released by "delete_volume" :: held 3.479s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:06 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c" returned: 0 in 0.781s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9dd983-d4e3-4033-811b-8ec7f12c810e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ce2139-6528-443a-85f1-4c908cc42ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:07 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Volume volume-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c (8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c): created successfully Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ce2139-6528-443a-85f1-4c908cc42ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Flow 'volume_create_manager' (429249a8-8c54-4559-a844-f3c75b760f29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-66679a5e-b6bd-4f35-90a8-af8082275883 tempest-VolumesActionsTest-281576991 None] Acquiring lock "cinder-fd85e85c-782f-4f49-a5f0-2dc49fee894c-detach_volume" by "detach_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:07 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-9ced25d4-b2d7-468c-a3fb-7232ac9c03fe tempest-VolumesActionsTest-1774596361 None] Created volume successfully. Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-66679a5e-b6bd-4f35-90a8-af8082275883 tempest-VolumesActionsTest-281576991 None] Lock "cinder-fd85e85c-782f-4f49-a5f0-2dc49fee894c-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:07 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-66679a5e-b6bd-4f35-90a8-af8082275883 tempest-VolumesActionsTest-281576991 None] Detaching volume fd85e85c-782f-4f49-a5f0-2dc49fee894c from instance 6db91b13-238d-4738-b104-ce45bec9ca8d. Feb 27 02:06:07 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-66679a5e-b6bd-4f35-90a8-af8082275883 tempest-VolumesActionsTest-281576991 None] Detach volume completed successfully. Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-66679a5e-b6bd-4f35-90a8-af8082275883 tempest-VolumesActionsTest-281576991 None] Lock "cinder-fd85e85c-782f-4f49-a5f0-2dc49fee894c-detach_volume" released by "detach_volume" :: held 0.077s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Flow 'volume_create_manager' (fd3b9a04-eda9-4a62-997b-1662dee1d5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e1c77c-0c9a-4916-abae-c9b3f7c45035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e1c77c-0c9a-4916-abae-c9b3f7c45035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1068242231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c5346d55be4ad98f5f3c5c6187865e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:07Z,use_quota=True,user_id='b10b67d85ac74d4bb206741e1c901815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025f589c-62bb-42ae-9f83-1edb20365c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025f589c-62bb-42ae-9f83-1edb20365c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8621ff-f5b7-41f0-a9b9-d65240e918e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8621ff-f5b7-41f0-a9b9-d65240e918e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa', 'volume_name': 'volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89529f30-990c-4d04-b0fb-5054455bc05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89529f30-990c-4d04-b0fb-5054455bc05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90622225-87cf-4400-bab8-77ab955c19d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:07 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Volume 180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa', 'volume_size': 1} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1068242231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c5346d55be4ad98f5f3c5c6187865e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:07Z,use_quota=True,user_id='b10b67d85ac74d4bb206741e1c901815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Creating volume 180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:07 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:06:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:07 devstack sudo[87391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa 1073741824 Feb 27 02:06:07 devstack sudo[87391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:08 devstack sudo[87391]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa 1073741824" returned: 0 in 0.654s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:08 devstack sudo[87404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa Feb 27 02:06:08 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9151f778-bbb9-4089-bfd3-0559f84c9110 tempest-VolumesActionsTest-1434842878 None] Acquiring lock "cinder-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9151f778-bbb9-4089-bfd3-0559f84c9110 tempest-VolumesActionsTest-1434842878 None] Lock "cinder-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9151f778-bbb9-4089-bfd3-0559f84c9110 tempest-VolumesActionsTest-1434842878 None] Acquiring lock "cinder-quobyte-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9151f778-bbb9-4089-bfd3-0559f84c9110 tempest-VolumesActionsTest-1434842878 None] Lock "cinder-quobyte-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c" acquired by "delete_volume" :: waited 0.024s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:08 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ed4d89-e1a8-47d6-aed7-111258ebbcee]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9151f778-bbb9-4089-bfd3-0559f84c9110 tempest-VolumesActionsTest-1434842878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:08 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c Feb 27 02:06:08 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:08 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa" returned: 0 in 0.694s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90622225-87cf-4400-bab8-77ab955c19d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa4b666-6439-4fc7-996e-36872bba9b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:08 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Volume volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa (180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa): created successfully Feb 27 02:06:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa4b666-6439-4fc7-996e-36872bba9b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Flow 'volume_create_manager' (fd3b9a04-eda9-4a62-997b-1662dee1d5f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:08 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-6d8ebd0c-6221-463d-a1ae-5f4763875681 tempest-VolumesDeleteCascade-1226226648 None] Created volume successfully. Feb 27 02:06:09 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9151f778-bbb9-4089-bfd3-0559f84c9110 tempest-VolumesActionsTest-1434842878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c" returned: 0 in 0.699s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9151f778-bbb9-4089-bfd3-0559f84c9110 tempest-VolumesActionsTest-1434842878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:09 devstack sudo[87449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c Feb 27 02:06:09 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b79744ae-2fcc-4682-855b-494e7c6df892 tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b79744ae-2fcc-4682-855b-494e7c6df892 tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b79744ae-2fcc-4682-855b-494e7c6df892 tempest-VolumesDeleteCascade-1226226648 None] Creating offline snapshot ef6537a3-afe3-4be8-ae88-734d2cd87cec of volume 180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:06:09 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7356fb6-f941-4891-9327-747c5b354985]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b79744ae-2fcc-4682-855b-494e7c6df892 tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:09 devstack sudo[87453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa Feb 27 02:06:09 devstack sudo[87453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:09 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9151f778-bbb9-4089-bfd3-0559f84c9110 tempest-VolumesActionsTest-1434842878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c" returned: 0 in 0.640s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9151f778-bbb9-4089-bfd3-0559f84c9110 tempest-VolumesActionsTest-1434842878 None] Lock "cinder-quobyte-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c" released by "delete_volume" :: held 1.375s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:09 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-9151f778-bbb9-4089-bfd3-0559f84c9110 tempest-VolumesActionsTest-1434842878 None] Created reservations ['c0b2d761-f20d-4f59-9613-6f7439fcaf67', 'c750851f-5776-43dd-99be-8cc5aa05e19c', '97df1947-6b9c-418a-8b80-1ccd51d37bbf', 'e3287dc3-b1cd-4272-80a2-4708114336f3'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9151f778-bbb9-4089-bfd3-0559f84c9110 tempest-VolumesActionsTest-1434842878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9151f778-bbb9-4089-bfd3-0559f84c9110 tempest-VolumesActionsTest-1434842878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9151f778-bbb9-4089-bfd3-0559f84c9110 tempest-VolumesActionsTest-1434842878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9151f778-bbb9-4089-bfd3-0559f84c9110 tempest-VolumesActionsTest-1434842878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9151f778-bbb9-4089-bfd3-0559f84c9110 tempest-VolumesActionsTest-1434842878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9151f778-bbb9-4089-bfd3-0559f84c9110 tempest-VolumesActionsTest-1434842878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:09 devstack sudo[87456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:06:09 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:10 devstack sudo[87453]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b79744ae-2fcc-4682-855b-494e7c6df892 tempest-VolumesDeleteCascade-1226226648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa" returned: 0 in 0.677s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b79744ae-2fcc-4682-855b-494e7c6df892 tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:10 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec 1G Feb 27 02:06:10 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:10 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9151f778-bbb9-4089-bfd3-0559f84c9110 tempest-VolumesActionsTest-1434842878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.664s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:10 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-9151f778-bbb9-4089-bfd3-0559f84c9110 tempest-VolumesActionsTest-1434842878 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:10 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-9151f778-bbb9-4089-bfd3-0559f84c9110 tempest-VolumesActionsTest-1434842878 None] Deleted volume successfully. Feb 27 02:06:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9151f778-bbb9-4089-bfd3-0559f84c9110 tempest-VolumesActionsTest-1434842878 None] Lock "cinder-8e4b75cc-6b5c-4a6c-adc2-b83e45f5ad2c-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:11 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Flow 'volume_create_manager' (894ebbf0-dbbe-4fa1-8155-352d6b4ba163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5c7852-226c-4850-b5d8-879cfdc4d52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5c7852-226c-4850-b5d8-879cfdc4d52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1780361259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca4f894-4bc5-4a2d-b810-5951ff83cc35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43968f761d94193a66baec8a7673d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:11Z,use_quota=True,user_id='2eb36ba0b2014b019009dd6339a4d0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d968cb71-95b6-41eb-9196-3bdc04217fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d968cb71-95b6-41eb-9196-3bdc04217fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc75395-6731-4837-a412-4acfb8dc3fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc75395-6731-4837-a412-4acfb8dc3fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ca4f894-4bc5-4a2d-b810-5951ff83cc35', 'volume_name': 'volume-8ca4f894-4bc5-4a2d-b810-5951ff83cc35', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67e745c0-c754-4107-a348-2e42303a850f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67e745c0-c754-4107-a348-2e42303a850f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9157a90e-0e81-4650-8686-41bb8a5947bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:11 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Volume 8ca4f894-4bc5-4a2d-b810-5951ff83cc35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ca4f894-4bc5-4a2d-b810-5951ff83cc35', 'volume_size': 1} Feb 27 02:06:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:11 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b79744ae-2fcc-4682-855b-494e7c6df892 tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec 1G" returned: 0 in 0.780s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b79744ae-2fcc-4682-855b-494e7c6df892 tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:11 devstack sudo[87468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec Feb 27 02:06:11 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:11 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b79744ae-2fcc-4682-855b-494e7c6df892 tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec" returned: 0 in 0.494s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:11 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b79744ae-2fcc-4682-855b-494e7c6df892 tempest-VolumesDeleteCascade-1226226648 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec is being set with open permissions: ugo+rw Feb 27 02:06:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b79744ae-2fcc-4682-855b-494e7c6df892 tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:11 devstack sudo[87473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec Feb 27 02:06:11 devstack sudo[87473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:12 devstack sudo[87473]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b79744ae-2fcc-4682-855b-494e7c6df892 tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec" returned: 0 in 0.432s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b79744ae-2fcc-4682-855b-494e7c6df892 tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:12 devstack sudo[87476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.info Feb 27 02:06:12 devstack sudo[87476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:12 devstack sudo[87476]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b79744ae-2fcc-4682-855b-494e7c6df892 tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.info" returned: 0 in 0.458s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:12 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b79744ae-2fcc-4682-855b-494e7c6df892 tempest-VolumesDeleteCascade-1226226648 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.info is being set with open permissions: ugo+rw Feb 27 02:06:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b79744ae-2fcc-4682-855b-494e7c6df892 tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:12 devstack sudo[87479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.info Feb 27 02:06:12 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:12 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b79744ae-2fcc-4682-855b-494e7c6df892 tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.info" returned: 0 in 0.404s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b79744ae-2fcc-4682-855b-494e7c6df892 tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.321s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.852s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1780361259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca4f894-4bc5-4a2d-b810-5951ff83cc35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43968f761d94193a66baec8a7673d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:11Z,use_quota=True,user_id='2eb36ba0b2014b019009dd6339a4d0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Creating volume 8ca4f894-4bc5-4a2d-b810-5951ff83cc35 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:12 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:06:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8ca4f894-4bc5-4a2d-b810-5951ff83cc35 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:12 devstack sudo[87482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8ca4f894-4bc5-4a2d-b810-5951ff83cc35 1073741824 Feb 27 02:06:12 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:12 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b79744ae-2fcc-4682-855b-494e7c6df892 tempest-VolumesDeleteCascade-1226226648 None] Create snapshot completed successfully Feb 27 02:06:13 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8ca4f894-4bc5-4a2d-b810-5951ff83cc35 1073741824" returned: 0 in 0.541s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8ca4f894-4bc5-4a2d-b810-5951ff83cc35 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:13 devstack sudo[87487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8ca4f894-4bc5-4a2d-b810-5951ff83cc35 Feb 27 02:06:13 devstack sudo[87487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d29aad2f-bce0-44dd-9dc0-653e87b5c2dd tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:14 devstack sudo[87487]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8ca4f894-4bc5-4a2d-b810-5951ff83cc35" returned: 0 in 0.510s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d29aad2f-bce0-44dd-9dc0-653e87b5c2dd tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.088s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d29aad2f-bce0-44dd-9dc0-653e87b5c2dd tempest-VolumesDeleteCascade-1226226648 None] Creating offline snapshot f6be6b6b-0cc7-4693-a570-c39eb97c3967 of volume 180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:06:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9157a90e-0e81-4650-8686-41bb8a5947bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca4f894-4bc5-4a2d-b810-5951ff83cc35', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0245200f-36c1-4afb-9f9d-db9d89bf9b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:14 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[439c5972-9798-411a-840a-b54125ad8713]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d29aad2f-bce0-44dd-9dc0-653e87b5c2dd tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:14 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Volume volume-8ca4f894-4bc5-4a2d-b810-5951ff83cc35 (8ca4f894-4bc5-4a2d-b810-5951ff83cc35): created successfully Feb 27 02:06:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0245200f-36c1-4afb-9f9d-db9d89bf9b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Flow 'volume_create_manager' (894ebbf0-dbbe-4fa1-8155-352d6b4ba163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:14 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-28856f6f-48df-4f7b-bc73-c7c886fb0b7d tempest-VolumesActionsTest-1774596361 None] Created volume successfully. Feb 27 02:06:14 devstack sudo[87490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec Feb 27 02:06:14 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:14 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d29aad2f-bce0-44dd-9dc0-653e87b5c2dd tempest-VolumesDeleteCascade-1226226648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec" returned: 0 in 0.621s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d29aad2f-bce0-44dd-9dc0-653e87b5c2dd tempest-VolumesDeleteCascade-1226226648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d29aad2f-bce0-44dd-9dc0-653e87b5c2dd tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:14 devstack sudo[87498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967 1G Feb 27 02:06:14 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a3d03f4a-fcbc-4f61-a675-e40c6b47eef1 tempest-VolumesActionsTest-1434842878 None] Acquiring lock "cinder-8ca4f894-4bc5-4a2d-b810-5951ff83cc35-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a3d03f4a-fcbc-4f61-a675-e40c6b47eef1 tempest-VolumesActionsTest-1434842878 None] Lock "cinder-8ca4f894-4bc5-4a2d-b810-5951ff83cc35-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:15 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d29aad2f-bce0-44dd-9dc0-653e87b5c2dd tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967 1G" returned: 0 in 0.759s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d29aad2f-bce0-44dd-9dc0-653e87b5c2dd tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:15 devstack sudo[87503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967 Feb 27 02:06:15 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a3d03f4a-fcbc-4f61-a675-e40c6b47eef1 tempest-VolumesActionsTest-1434842878 None] Acquiring lock "cinder-quobyte-8ca4f894-4bc5-4a2d-b810-5951ff83cc35" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a3d03f4a-fcbc-4f61-a675-e40c6b47eef1 tempest-VolumesActionsTest-1434842878 None] Lock "cinder-quobyte-8ca4f894-4bc5-4a2d-b810-5951ff83cc35" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:15 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba844ec-eb0c-40b1-a82c-dbb4f80beab4]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3d03f4a-fcbc-4f61-a675-e40c6b47eef1 tempest-VolumesActionsTest-1434842878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8ca4f894-4bc5-4a2d-b810-5951ff83cc35 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:15 devstack sudo[87505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8ca4f894-4bc5-4a2d-b810-5951ff83cc35 Feb 27 02:06:15 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:16 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d29aad2f-bce0-44dd-9dc0-653e87b5c2dd tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967" returned: 0 in 0.582s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:16 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-d29aad2f-bce0-44dd-9dc0-653e87b5c2dd tempest-VolumesDeleteCascade-1226226648 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967 is being set with open permissions: ugo+rw Feb 27 02:06:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d29aad2f-bce0-44dd-9dc0-653e87b5c2dd tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:16 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967 Feb 27 02:06:16 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:16 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3d03f4a-fcbc-4f61-a675-e40c6b47eef1 tempest-VolumesActionsTest-1434842878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8ca4f894-4bc5-4a2d-b810-5951ff83cc35" returned: 0 in 0.671s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3d03f4a-fcbc-4f61-a675-e40c6b47eef1 tempest-VolumesActionsTest-1434842878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8ca4f894-4bc5-4a2d-b810-5951ff83cc35 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:16 devstack sudo[87518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8ca4f894-4bc5-4a2d-b810-5951ff83cc35 Feb 27 02:06:16 devstack sudo[87518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:16 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d29aad2f-bce0-44dd-9dc0-653e87b5c2dd tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967" returned: 0 in 0.541s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d29aad2f-bce0-44dd-9dc0-653e87b5c2dd tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.596s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:16 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d29aad2f-bce0-44dd-9dc0-653e87b5c2dd tempest-VolumesDeleteCascade-1226226648 None] Create snapshot completed successfully Feb 27 02:06:16 devstack sudo[87518]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3d03f4a-fcbc-4f61-a675-e40c6b47eef1 tempest-VolumesActionsTest-1434842878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8ca4f894-4bc5-4a2d-b810-5951ff83cc35" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a3d03f4a-fcbc-4f61-a675-e40c6b47eef1 tempest-VolumesActionsTest-1434842878 None] Lock "cinder-quobyte-8ca4f894-4bc5-4a2d-b810-5951ff83cc35" released by "delete_volume" :: held 1.230s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:16 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-a3d03f4a-fcbc-4f61-a675-e40c6b47eef1 tempest-VolumesActionsTest-1434842878 None] Created reservations ['25923843-1276-46da-92be-552c4bd661f1', '9e8ad896-bcd1-4cdd-bc66-70f0d0992cd0', 'efc1bbd3-01ff-436c-ad75-81a426cef871', '639c6f18-ac44-4741-8043-34079f500c60'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3d03f4a-fcbc-4f61-a675-e40c6b47eef1 tempest-VolumesActionsTest-1434842878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3d03f4a-fcbc-4f61-a675-e40c6b47eef1 tempest-VolumesActionsTest-1434842878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a3d03f4a-fcbc-4f61-a675-e40c6b47eef1 tempest-VolumesActionsTest-1434842878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a3d03f4a-fcbc-4f61-a675-e40c6b47eef1 tempest-VolumesActionsTest-1434842878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3d03f4a-fcbc-4f61-a675-e40c6b47eef1 tempest-VolumesActionsTest-1434842878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3d03f4a-fcbc-4f61-a675-e40c6b47eef1 tempest-VolumesActionsTest-1434842878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:16 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:06:16 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "cinder-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Performing cascade delete. {{(pid=83167) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 27 02:06:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "cinder-ef6537a3-afe3-4be8-ae88-734d2cd87cec-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-ef6537a3-afe3-4be8-ae88-734d2cd87cec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "cinder-quobyte-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "cinder-quobyte-ef6537a3-afe3-4be8-ae88-734d2cd87cec" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-ef6537a3-afe3-4be8-ae88-734d2cd87cec" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Deleting offline snapshot ef6537a3-afe3-4be8-ae88-734d2cd87cec of volume 180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:06:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] snapshot_file for this snap is: volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:06:17 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f767b5-ad2c-480d-90fd-b46a89c85d18]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:17 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3d03f4a-fcbc-4f61-a675-e40c6b47eef1 tempest-VolumesActionsTest-1434842878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.568s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:17 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-a3d03f4a-fcbc-4f61-a675-e40c6b47eef1 tempest-VolumesActionsTest-1434842878 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:17 devstack sudo[87526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec Feb 27 02:06:17 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:17 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a3d03f4a-fcbc-4f61-a675-e40c6b47eef1 tempest-VolumesActionsTest-1434842878 None] Deleted volume successfully. Feb 27 02:06:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a3d03f4a-fcbc-4f61-a675-e40c6b47eef1 tempest-VolumesActionsTest-1434842878 None] Lock "cinder-8ca4f894-4bc5-4a2d-b810-5951ff83cc35-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:17 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec" returned: 0 in 0.647s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[256bdc1c-588f-417e-a702-f203c2af0083]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Flow 'volume_create_manager' (c1341fa6-5f38-4f49-84c9-7893bf2b7181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:18 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa Feb 27 02:06:18 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010d5e2a-622f-45b5-8266-8afaf6d6a087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010d5e2a-622f-45b5-8266-8afaf6d6a087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1771997298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43968f761d94193a66baec8a7673d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:18Z,use_quota=True,user_id='2eb36ba0b2014b019009dd6339a4d0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743c1458-dc86-41be-afe5-20c5c370cc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743c1458-dc86-41be-afe5-20c5c370cc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2cdd5a-e6e5-4b8a-aa13-ae281d886e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2cdd5a-e6e5-4b8a-aa13-ae281d886e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d', 'volume_name': 'volume-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098bb7a4-c995-4dc1-866f-51ed2cff6d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098bb7a4-c995-4dc1-866f-51ed2cff6d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b48eafe-a750-46ae-8f75-ce623509acb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:18 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Volume de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d', 'volume_size': 1} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1771997298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43968f761d94193a66baec8a7673d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:18Z,use_quota=True,user_id='2eb36ba0b2014b019009dd6339a4d0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Creating volume de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:18 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:18 devstack sudo[87534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d 1073741824 Feb 27 02:06:18 devstack sudo[87534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:18 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa" returned: 0 in 0.600s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5681d776-1b2d-428e-ab51-08117e70fd0a]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:18 devstack sudo[87542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967 Feb 27 02:06:18 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:18 devstack sudo[87534]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d 1073741824" returned: 0 in 0.623s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:18 devstack sudo[87544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d Feb 27 02:06:18 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:19 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967" returned: 0 in 0.583s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[361f3755-1632-459e-998e-935ec61877f3]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:19 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d" returned: 0 in 0.471s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b48eafe-a750-46ae-8f75-ce623509acb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9acc1b4-dbe4-4ecd-a7e0-1929495103c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Volume volume-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d (de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d): created successfully Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9acc1b4-dbe4-4ecd-a7e0-1929495103c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:19 devstack sudo[87550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec Feb 27 02:06:19 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Flow 'volume_create_manager' (c1341fa6-5f38-4f49-84c9-7893bf2b7181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:19 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ccf983fd-86b9-4c40-99b1-8428243d8111 tempest-VolumesActionsTest-1774596361 None] Created volume successfully. Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Flow 'volume_create_manager' (b0c2c0cd-6e89-48a3-aca9-e4a449c7d4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cea2551-ddaf-4cc2-b7b2-fa356abc95b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cea2551-ddaf-4cc2-b7b2-fa356abc95b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-805824862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9491cc-a1bd-44fb-8998-305d397ae6c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81db6a3c0626412abe3b7e8773a9598b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:19Z,use_quota=True,user_id='cc57a688aab74a20a53959d8747c744f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e522b6-f821-4312-8ce1-57068875e85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e522b6-f821-4312-8ce1-57068875e85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7defb99-934d-4362-bcc2-13f7acbc2ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7defb99-934d-4362-bcc2-13f7acbc2ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd9491cc-a1bd-44fb-8998-305d397ae6c0', 'volume_name': 'volume-fd9491cc-a1bd-44fb-8998-305d397ae6c0', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56454563-05ea-493d-8cc1-9b8749204250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56454563-05ea-493d-8cc1-9b8749204250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e373c8-7dab-4a97-bb5b-f7c5dc888637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Volume fd9491cc-a1bd-44fb-8998-305d397ae6c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd9491cc-a1bd-44fb-8998-305d397ae6c0', 'volume_size': 1} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-805824862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9491cc-a1bd-44fb-8998-305d397ae6c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81db6a3c0626412abe3b7e8773a9598b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:19Z,use_quota=True,user_id='cc57a688aab74a20a53959d8747c744f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Creating volume fd9491cc-a1bd-44fb-8998-305d397ae6c0 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:19 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd9491cc-a1bd-44fb-8998-305d397ae6c0 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:19 devstack sudo[87552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd9491cc-a1bd-44fb-8998-305d397ae6c0 1073741824 Feb 27 02:06:19 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:19 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec" returned: 0 in 0.607s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c233b7e4-aad9-4b54-af11-e6e6cd18fea6]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:19 devstack sudo[87557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa Feb 27 02:06:19 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:20 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd9491cc-a1bd-44fb-8998-305d397ae6c0 1073741824" returned: 0 in 0.487s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd9491cc-a1bd-44fb-8998-305d397ae6c0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:20 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd9491cc-a1bd-44fb-8998-305d397ae6c0 Feb 27 02:06:20 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-76d4ff18-3750-4fa9-9f6a-c3d60db5914a tempest-VolumesActionsTest-1434842878 None] Acquiring lock "cinder-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-76d4ff18-3750-4fa9-9f6a-c3d60db5914a tempest-VolumesActionsTest-1434842878 None] Lock "cinder-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-76d4ff18-3750-4fa9-9f6a-c3d60db5914a tempest-VolumesActionsTest-1434842878 None] Acquiring lock "cinder-quobyte-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-76d4ff18-3750-4fa9-9f6a-c3d60db5914a tempest-VolumesActionsTest-1434842878 None] Lock "cinder-quobyte-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:20 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[92df48e1-c8e1-471b-8ec8-667415bf4472]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-76d4ff18-3750-4fa9-9f6a-c3d60db5914a tempest-VolumesActionsTest-1434842878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:20 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa" returned: 0 in 0.580s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:20 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec Feb 27 02:06:20 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:20 devstack sudo[87567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d Feb 27 02:06:20 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:20 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd9491cc-a1bd-44fb-8998-305d397ae6c0" returned: 0 in 0.576s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e373c8-7dab-4a97-bb5b-f7c5dc888637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd9491cc-a1bd-44fb-8998-305d397ae6c0', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc25166-c3c3-44b4-ab9f-d9138f6cde66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:20 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Volume volume-fd9491cc-a1bd-44fb-8998-305d397ae6c0 (fd9491cc-a1bd-44fb-8998-305d397ae6c0): created successfully Feb 27 02:06:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc25166-c3c3-44b4-ab9f-d9138f6cde66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Flow 'volume_create_manager' (b0c2c0cd-6e89-48a3-aca9-e4a449c7d4d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:20 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-d9fa2b39-399f-4493-9e35-bf9facc45557 req-e9e2243d-1f32-4328-8281-9383268e3eca tempest-VolumesGetTestJSON-425750705 None] Created volume successfully. Feb 27 02:06:21 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec" returned: 0 in 0.591s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:21 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-76d4ff18-3750-4fa9-9f6a-c3d60db5914a tempest-VolumesActionsTest-1434842878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d" returned: 0 in 0.633s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-76d4ff18-3750-4fa9-9f6a-c3d60db5914a tempest-VolumesActionsTest-1434842878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:21 devstack sudo[87578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec Feb 27 02:06:21 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:21 devstack sudo[87579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d Feb 27 02:06:21 devstack sudo[87579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:21 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.ef6537a3-afe3-4be8-ae88-734d2cd87cec" returned: 0 in 0.532s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967 -F qcow2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:21 devstack sudo[87579]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-76d4ff18-3750-4fa9-9f6a-c3d60db5914a tempest-VolumesActionsTest-1434842878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d" returned: 0 in 0.537s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-76d4ff18-3750-4fa9-9f6a-c3d60db5914a tempest-VolumesActionsTest-1434842878 None] Lock "cinder-quobyte-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d" released by "delete_volume" :: held 1.198s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:21 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967 -F qcow2 Feb 27 02:06:21 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:21 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-76d4ff18-3750-4fa9-9f6a-c3d60db5914a tempest-VolumesActionsTest-1434842878 None] Created reservations ['eb6c3571-84fe-4108-b13d-d7c135679364', '122b0d0f-bf12-422f-a4d8-39bbd89f3ff9', 'b55397d4-5abe-4768-b17f-40426a8c3fe1', '77c98acb-50e9-41e3-9167-b46222214f96'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-76d4ff18-3750-4fa9-9f6a-c3d60db5914a tempest-VolumesActionsTest-1434842878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-76d4ff18-3750-4fa9-9f6a-c3d60db5914a tempest-VolumesActionsTest-1434842878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-76d4ff18-3750-4fa9-9f6a-c3d60db5914a tempest-VolumesActionsTest-1434842878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-76d4ff18-3750-4fa9-9f6a-c3d60db5914a tempest-VolumesActionsTest-1434842878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-76d4ff18-3750-4fa9-9f6a-c3d60db5914a tempest-VolumesActionsTest-1434842878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-76d4ff18-3750-4fa9-9f6a-c3d60db5914a tempest-VolumesActionsTest-1434842878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:21 devstack sudo[87586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:06:21 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-cdbb7d7a-1f5e-493f-803a-12fd2c66dd22 req-6efe4f4e-978b-4c39-9161-b35bad3da910 tempest-VolumesGetTestJSON-425750705 None] Acquiring lock "cinder-fd9491cc-a1bd-44fb-8998-305d397ae6c0-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-cdbb7d7a-1f5e-493f-803a-12fd2c66dd22 req-6efe4f4e-978b-4c39-9161-b35bad3da910 tempest-VolumesGetTestJSON-425750705 None] Lock "cinder-fd9491cc-a1bd-44fb-8998-305d397ae6c0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-cdbb7d7a-1f5e-493f-803a-12fd2c66dd22 req-6efe4f4e-978b-4c39-9161-b35bad3da910 tempest-VolumesGetTestJSON-425750705 None] Acquiring lock "cinder-quobyte-fd9491cc-a1bd-44fb-8998-305d397ae6c0" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-cdbb7d7a-1f5e-493f-803a-12fd2c66dd22 req-6efe4f4e-978b-4c39-9161-b35bad3da910 tempest-VolumesGetTestJSON-425750705 None] Lock "cinder-quobyte-fd9491cc-a1bd-44fb-8998-305d397ae6c0" acquired by "delete_volume" :: waited 0.020s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae2d36b-d1b6-492b-ba90-d6cad25aa6c8]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-cdbb7d7a-1f5e-493f-803a-12fd2c66dd22 req-6efe4f4e-978b-4c39-9161-b35bad3da910 tempest-VolumesGetTestJSON-425750705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd9491cc-a1bd-44fb-8998-305d397ae6c0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:22 devstack sudo[87588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd9491cc-a1bd-44fb-8998-305d397ae6c0 Feb 27 02:06:22 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:22 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-76d4ff18-3750-4fa9-9f6a-c3d60db5914a tempest-VolumesActionsTest-1434842878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.612s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-76d4ff18-3750-4fa9-9f6a-c3d60db5914a tempest-VolumesActionsTest-1434842878 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:22 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:22 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-76d4ff18-3750-4fa9-9f6a-c3d60db5914a tempest-VolumesActionsTest-1434842878 None] Deleted volume successfully. Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967 -F qcow2" returned: 0 in 0.738s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-ef6537a3-afe3-4be8-ae88-734d2cd87cec" released by "_delete_snapshot" :: held 5.025s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa" released by "delete_snapshot" :: held 5.042s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-76d4ff18-3750-4fa9-9f6a-c3d60db5914a tempest-VolumesActionsTest-1434842878 None] Lock "cinder-de4170fd-76a6-4e7f-a800-a8ac0f5dbb3d-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Created reservations ['e0c0d03a-4906-4f43-b727-a26e46bea4c5', '5e4e9a98-6da1-48e6-b4cf-a8d02903615e', 'c9247e9e-2375-416d-b56c-93078f4ca1f6', '5eb0de39-22cc-4110-bc59-e3e29df54264'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:22 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Delete snapshot completed successfully. Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-ef6537a3-afe3-4be8-ae88-734d2cd87cec-delete_snapshot" released by "delete_snapshot" :: held 5.194s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "cinder-f6be6b6b-0cc7-4693-a570-c39eb97c3967-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-f6be6b6b-0cc7-4693-a570-c39eb97c3967-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "cinder-quobyte-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "cinder-quobyte-f6be6b6b-0cc7-4693-a570-c39eb97c3967" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-f6be6b6b-0cc7-4693-a570-c39eb97c3967" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Deleting offline snapshot f6be6b6b-0cc7-4693-a570-c39eb97c3967 of volume 180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] snapshot_file for this snap is: volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bff9fba-45aa-4aa5-b7fb-3df5cba74c05]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:22 devstack sudo[87596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967 Feb 27 02:06:22 devstack sudo[87596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:22 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-cdbb7d7a-1f5e-493f-803a-12fd2c66dd22 req-6efe4f4e-978b-4c39-9161-b35bad3da910 tempest-VolumesGetTestJSON-425750705 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd9491cc-a1bd-44fb-8998-305d397ae6c0" returned: 0 in 0.683s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-cdbb7d7a-1f5e-493f-803a-12fd2c66dd22 req-6efe4f4e-978b-4c39-9161-b35bad3da910 tempest-VolumesGetTestJSON-425750705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd9491cc-a1bd-44fb-8998-305d397ae6c0 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:22 devstack sudo[87610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd9491cc-a1bd-44fb-8998-305d397ae6c0 Feb 27 02:06:22 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Flow 'volume_create_manager' (6524cc67-a7e3-461f-8fe9-24693ca32666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc78be47-eae4-4f29-a4dd-4c2190298c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc78be47-eae4-4f29-a4dd-4c2190298c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1794795945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3a2b04-ed96-4aab-9efd-174735a1fb4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43968f761d94193a66baec8a7673d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:23Z,use_quota=True,user_id='2eb36ba0b2014b019009dd6339a4d0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cbdc988-ff49-4aad-b975-c24f076dd71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cbdc988-ff49-4aad-b975-c24f076dd71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d080c4c-9e4b-47a1-9147-0df9217bfb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d080c4c-9e4b-47a1-9147-0df9217bfb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e3a2b04-ed96-4aab-9efd-174735a1fb4f', 'volume_name': 'volume-9e3a2b04-ed96-4aab-9efd-174735a1fb4f', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (086482fb-da1e-46b4-b1a3-6253524b35a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (086482fb-da1e-46b4-b1a3-6253524b35a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9568c2-4db0-4c5f-a666-cfb0c8493acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:22 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Volume 9e3a2b04-ed96-4aab-9efd-174735a1fb4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e3a2b04-ed96-4aab-9efd-174735a1fb4f', 'volume_size': 1} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1794795945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3a2b04-ed96-4aab-9efd-174735a1fb4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43968f761d94193a66baec8a7673d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:23Z,use_quota=True,user_id='2eb36ba0b2014b019009dd6339a4d0b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Creating volume 9e3a2b04-ed96-4aab-9efd-174735a1fb4f {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:22 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:06:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e3a2b04-ed96-4aab-9efd-174735a1fb4f 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:23 devstack sudo[87617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e3a2b04-ed96-4aab-9efd-174735a1fb4f 1073741824 Feb 27 02:06:23 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:23 devstack sudo[87596]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967" returned: 0 in 0.657s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:23 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6528c531-d487-4ddf-8f03-287d6f9bc0c7]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:23 devstack sudo[87622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa Feb 27 02:06:23 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:23 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-cdbb7d7a-1f5e-493f-803a-12fd2c66dd22 req-6efe4f4e-978b-4c39-9161-b35bad3da910 tempest-VolumesGetTestJSON-425750705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd9491cc-a1bd-44fb-8998-305d397ae6c0" returned: 0 in 0.589s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-cdbb7d7a-1f5e-493f-803a-12fd2c66dd22 req-6efe4f4e-978b-4c39-9161-b35bad3da910 tempest-VolumesGetTestJSON-425750705 None] Lock "cinder-quobyte-fd9491cc-a1bd-44fb-8998-305d397ae6c0" released by "delete_volume" :: held 1.307s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:23 devstack cinder-volume[83167]: DEBUG cinder.quota [req-cdbb7d7a-1f5e-493f-803a-12fd2c66dd22 req-6efe4f4e-978b-4c39-9161-b35bad3da910 tempest-VolumesGetTestJSON-425750705 None] Created reservations ['1abc7c10-c674-4f8f-a571-3876c2ba3f5f', 'c501dd06-90ac-4c4d-b5d1-92889be700ab', '5896aa95-c80c-451e-a9b6-a30d26691fc6', '9e2586f4-da1c-48a9-862b-4c660cdd297e'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-cdbb7d7a-1f5e-493f-803a-12fd2c66dd22 req-6efe4f4e-978b-4c39-9161-b35bad3da910 tempest-VolumesGetTestJSON-425750705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-cdbb7d7a-1f5e-493f-803a-12fd2c66dd22 req-6efe4f4e-978b-4c39-9161-b35bad3da910 tempest-VolumesGetTestJSON-425750705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-cdbb7d7a-1f5e-493f-803a-12fd2c66dd22 req-6efe4f4e-978b-4c39-9161-b35bad3da910 tempest-VolumesGetTestJSON-425750705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [req-cdbb7d7a-1f5e-493f-803a-12fd2c66dd22 req-6efe4f4e-978b-4c39-9161-b35bad3da910 tempest-VolumesGetTestJSON-425750705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [req-cdbb7d7a-1f5e-493f-803a-12fd2c66dd22 req-6efe4f4e-978b-4c39-9161-b35bad3da910 tempest-VolumesGetTestJSON-425750705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-cdbb7d7a-1f5e-493f-803a-12fd2c66dd22 req-6efe4f4e-978b-4c39-9161-b35bad3da910 tempest-VolumesGetTestJSON-425750705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:23 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:06:23 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:23 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e3a2b04-ed96-4aab-9efd-174735a1fb4f 1073741824" returned: 0 in 0.640s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e3a2b04-ed96-4aab-9efd-174735a1fb4f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:23 devstack sudo[87630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e3a2b04-ed96-4aab-9efd-174735a1fb4f Feb 27 02:06:23 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:23 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa" returned: 0 in 0.599s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:23 devstack sudo[87635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967 Feb 27 02:06:23 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:23 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [req-cdbb7d7a-1f5e-493f-803a-12fd2c66dd22 req-6efe4f4e-978b-4c39-9161-b35bad3da910 tempest-VolumesGetTestJSON-425750705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.461s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:23 devstack cinder-volume[83167]: DEBUG cinder.manager [req-cdbb7d7a-1f5e-493f-803a-12fd2c66dd22 req-6efe4f4e-978b-4c39-9161-b35bad3da910 tempest-VolumesGetTestJSON-425750705 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:23 devstack cinder-volume[83167]: INFO cinder.volume.manager [req-cdbb7d7a-1f5e-493f-803a-12fd2c66dd22 req-6efe4f4e-978b-4c39-9161-b35bad3da910 tempest-VolumesGetTestJSON-425750705 None] Deleted volume successfully. Feb 27 02:06:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [req-cdbb7d7a-1f5e-493f-803a-12fd2c66dd22 req-6efe4f4e-978b-4c39-9161-b35bad3da910 tempest-VolumesGetTestJSON-425750705 None] Lock "cinder-fd9491cc-a1bd-44fb-8998-305d397ae6c0-delete_volume" released by "delete_volume" :: held 2.013s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:24 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e3a2b04-ed96-4aab-9efd-174735a1fb4f" returned: 0 in 0.440s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9568c2-4db0-4c5f-a666-cfb0c8493acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e3a2b04-ed96-4aab-9efd-174735a1fb4f', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e039a6cb-2291-4dee-a017-4baebf307242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:24 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Volume volume-9e3a2b04-ed96-4aab-9efd-174735a1fb4f (9e3a2b04-ed96-4aab-9efd-174735a1fb4f): created successfully Feb 27 02:06:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e039a6cb-2291-4dee-a017-4baebf307242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Flow 'volume_create_manager' (6524cc67-a7e3-461f-8fe9-24693ca32666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:24 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-82006eac-ff22-4a3f-a324-adfbe2a015b8 tempest-VolumesActionsTest-1774596361 None] Created volume successfully. Feb 27 02:06:24 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967" returned: 0 in 0.581s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:24 devstack sudo[87642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967 Feb 27 02:06:24 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:25 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa.f6be6b6b-0cc7-4693-a570-c39eb97c3967" returned: 0 in 0.645s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-f6be6b6b-0cc7-4693-a570-c39eb97c3967" released by "_delete_snapshot" :: held 2.561s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa" released by "delete_snapshot" :: held 2.580s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:25 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Created reservations ['57501fb4-f168-424d-b033-acba6a6bd50f', '7e6c2fac-063e-45c2-b889-79ec37317fc7', 'fd564445-eb9e-4885-9443-d4ced063fb46', 'b76da16f-d084-4ead-8460-deab5f1a8067'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:25 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Delete snapshot completed successfully. Feb 27 02:06:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-f6be6b6b-0cc7-4693-a570-c39eb97c3967-delete_snapshot" released by "delete_snapshot" :: held 2.721s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Snapshots deleted, issuing volume delete {{(pid=83167) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 27 02:06:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "cinder-quobyte-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa" acquired by "delete_volume" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:25 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aed6713-428f-4443-98cb-470ce9a06b50]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:25 devstack sudo[87645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa Feb 27 02:06:25 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:25 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa" returned: 0 in 0.666s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:25 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa Feb 27 02:06:25 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0f1ca9b8-2611-4be9-ace5-7ce81b571624 tempest-VolumesActionsTest-1774596361 None] Acquiring lock "cinder-9e3a2b04-ed96-4aab-9efd-174735a1fb4f-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0f1ca9b8-2611-4be9-ace5-7ce81b571624 tempest-VolumesActionsTest-1774596361 None] Lock "cinder-9e3a2b04-ed96-4aab-9efd-174735a1fb4f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0f1ca9b8-2611-4be9-ace5-7ce81b571624 tempest-VolumesActionsTest-1774596361 None] Acquiring lock "cinder-quobyte-9e3a2b04-ed96-4aab-9efd-174735a1fb4f" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0f1ca9b8-2611-4be9-ace5-7ce81b571624 tempest-VolumesActionsTest-1774596361 None] Lock "cinder-quobyte-9e3a2b04-ed96-4aab-9efd-174735a1fb4f" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:26 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[20945569-ed6f-4aef-9e8a-45ad6431d0e4]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0f1ca9b8-2611-4be9-ace5-7ce81b571624 tempest-VolumesActionsTest-1774596361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e3a2b04-ed96-4aab-9efd-174735a1fb4f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:26 devstack sudo[87655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e3a2b04-ed96-4aab-9efd-174735a1fb4f Feb 27 02:06:26 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:26 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa" returned: 0 in 0.684s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa" released by "delete_volume" :: held 1.392s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:26 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Created reservations ['14f408e8-43dc-4f96-b60d-df8fa8dbf413', 'dc353ebf-6108-4e88-ae56-9b2509efea34', '7f579228-4ee9-4431-b6ce-919ee7469363', '4a213387-83dd-4d2b-b5f3-3990db12789f'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:26 devstack sudo[87661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:06:26 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:26 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0f1ca9b8-2611-4be9-ace5-7ce81b571624 tempest-VolumesActionsTest-1774596361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e3a2b04-ed96-4aab-9efd-174735a1fb4f" returned: 0 in 0.647s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0f1ca9b8-2611-4be9-ace5-7ce81b571624 tempest-VolumesActionsTest-1774596361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e3a2b04-ed96-4aab-9efd-174735a1fb4f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:26 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e3a2b04-ed96-4aab-9efd-174735a1fb4f Feb 27 02:06:26 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:27 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.466s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:27 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Deleted volume successfully. Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-960a66ee-5a1d-4c56-b5a5-40898edd73af tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-180ef9d8-f1e2-4d8c-bee3-0b4fad4787fa-delete_volume" released by "delete_volume" :: held 10.063s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:27 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0f1ca9b8-2611-4be9-ace5-7ce81b571624 tempest-VolumesActionsTest-1774596361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e3a2b04-ed96-4aab-9efd-174735a1fb4f" returned: 0 in 0.697s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0f1ca9b8-2611-4be9-ace5-7ce81b571624 tempest-VolumesActionsTest-1774596361 None] Lock "cinder-quobyte-9e3a2b04-ed96-4aab-9efd-174735a1fb4f" released by "delete_volume" :: held 1.374s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Flow 'volume_create_manager' (83f5bce2-c96d-4466-979a-4aaf484cfccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4f3ab3-d224-4fdc-b805-d3cb090421f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-0f1ca9b8-2611-4be9-ace5-7ce81b571624 tempest-VolumesActionsTest-1774596361 None] Created reservations ['9c2da5c6-21f1-416b-a8cf-29050467df71', '13278753-70d3-4f82-b602-d3c023564843', 'bd9e795f-aebd-49e9-8109-ce1023a6a08f', 'fe966bb7-5f47-4dba-963b-fb213514f846'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4f3ab3-d224-4fdc-b805-d3cb090421f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1388633209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f597944-110b-412f-bbe5-9e4dcd3bdbdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c5346d55be4ad98f5f3c5c6187865e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:27Z,use_quota=True,user_id='b10b67d85ac74d4bb206741e1c901815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8862ba01-7687-4d01-b716-2cc53681724e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8862ba01-7687-4d01-b716-2cc53681724e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8c4dbd-a7e8-475b-93e9-53da736cfea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8c4dbd-a7e8-475b-93e9-53da736cfea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f597944-110b-412f-bbe5-9e4dcd3bdbdb', 'volume_name': 'volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de31935-5def-49f7-892d-e94e743e9502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de31935-5def-49f7-892d-e94e743e9502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7d4e29-a142-455f-9384-44fc2b2977f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:27 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Volume 3f597944-110b-412f-bbe5-9e4dcd3bdbdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb', 'volume_size': 1} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1388633209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f597944-110b-412f-bbe5-9e4dcd3bdbdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c5346d55be4ad98f5f3c5c6187865e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:27Z,use_quota=True,user_id='b10b67d85ac74d4bb206741e1c901815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Creating volume 3f597944-110b-412f-bbe5-9e4dcd3bdbdb {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:27 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:27 devstack sudo[87693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb 1073741824 Feb 27 02:06:27 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0f1ca9b8-2611-4be9-ace5-7ce81b571624 tempest-VolumesActionsTest-1774596361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0f1ca9b8-2611-4be9-ace5-7ce81b571624 tempest-VolumesActionsTest-1774596361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0f1ca9b8-2611-4be9-ace5-7ce81b571624 tempest-VolumesActionsTest-1774596361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0f1ca9b8-2611-4be9-ace5-7ce81b571624 tempest-VolumesActionsTest-1774596361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0f1ca9b8-2611-4be9-ace5-7ce81b571624 tempest-VolumesActionsTest-1774596361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0f1ca9b8-2611-4be9-ace5-7ce81b571624 tempest-VolumesActionsTest-1774596361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:27 devstack sudo[87696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:06:27 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:28 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0f1ca9b8-2611-4be9-ace5-7ce81b571624 tempest-VolumesActionsTest-1774596361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.575s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:28 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-0f1ca9b8-2611-4be9-ace5-7ce81b571624 tempest-VolumesActionsTest-1774596361 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:28 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-0f1ca9b8-2611-4be9-ace5-7ce81b571624 tempest-VolumesActionsTest-1774596361 None] Deleted volume successfully. Feb 27 02:06:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0f1ca9b8-2611-4be9-ace5-7ce81b571624 tempest-VolumesActionsTest-1774596361 None] Lock "cinder-9e3a2b04-ed96-4aab-9efd-174735a1fb4f-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:28 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb 1073741824" returned: 0 in 0.813s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:28 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb Feb 27 02:06:28 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1214d0af-4473-4dee-987d-b5e7da18e4a3 tempest-BackendsCapabilitiesAdminTestsJSON-1516286104 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83167) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 27 02:06:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-db49a646-6960-42e7-819e-89138d1a3e9b tempest-BackendsCapabilitiesAdminTestsJSON-1516286104 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83167) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 27 02:06:29 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb" returned: 0 in 1.107s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7d4e29-a142-455f-9384-44fc2b2977f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8885bcb-00bc-40ed-9882-73d5ed346081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:29 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Volume volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb (3f597944-110b-412f-bbe5-9e4dcd3bdbdb): created successfully Feb 27 02:06:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8885bcb-00bc-40ed-9882-73d5ed346081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Flow 'volume_create_manager' (83f5bce2-c96d-4466-979a-4aaf484cfccf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:29 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-39232c51-5693-4670-a22f-3e1d04aad59b tempest-VolumesDeleteCascade-1226226648 None] Created volume successfully. Feb 27 02:06:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ec9f4f74-90ce-4465-97de-95410991548c tempest-VolumesActionsTest-281576991 None] Acquiring lock "cinder-fd85e85c-782f-4f49-a5f0-2dc49fee894c" by "attach_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:30 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:06:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:30 devstack sudo[87707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:06:30 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ec9f4f74-90ce-4465-97de-95410991548c tempest-VolumesActionsTest-281576991 None] Lock "cinder-fd85e85c-782f-4f49-a5f0-2dc49fee894c" acquired by "attach_volume" :: waited 0.111s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2349f602-7a61-40b7-9001-173ecceb0f3a tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2349f602-7a61-40b7-9001-173ecceb0f3a tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-2349f602-7a61-40b7-9001-173ecceb0f3a tempest-VolumesDeleteCascade-1226226648 None] Creating offline snapshot 5ec02e5b-222d-457f-9165-b2d40b86ee09 of volume 3f597944-110b-412f-bbe5-9e4dcd3bdbdb {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:06:31 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[613f6eb0-e339-4c0f-90e8-44e82d03cd63]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2349f602-7a61-40b7-9001-173ecceb0f3a tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:31 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ec9f4f74-90ce-4465-97de-95410991548c tempest-VolumesActionsTest-281576991 None] Attaching volume fd85e85c-782f-4f49-a5f0-2dc49fee894c to instance 95c07f40-186a-4d85-9411-1e9d6c977f27 at mountpoint /dev/vdb on host None. Feb 27 02:06:31 devstack sudo[87709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb Feb 27 02:06:31 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:31 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ec9f4f74-90ce-4465-97de-95410991548c tempest-VolumesActionsTest-281576991 None] Attach volume completed successfully. Feb 27 02:06:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ec9f4f74-90ce-4465-97de-95410991548c tempest-VolumesActionsTest-281576991 None] Lock "cinder-fd85e85c-782f-4f49-a5f0-2dc49fee894c" released by "attach_volume" :: held 0.411s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:31 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.587s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:31 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:32 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2349f602-7a61-40b7-9001-173ecceb0f3a tempest-VolumesDeleteCascade-1226226648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb" returned: 0 in 1.016s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2349f602-7a61-40b7-9001-173ecceb0f3a tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:32 devstack sudo[87717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09 1G Feb 27 02:06:32 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-841ca497-6c91-4100-882b-2d39d9d08b7a tempest-VolumesActionsTest-281576991 None] Acquiring lock "cinder-fd85e85c-782f-4f49-a5f0-2dc49fee894c-detach_volume" by "detach_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-841ca497-6c91-4100-882b-2d39d9d08b7a tempest-VolumesActionsTest-281576991 None] Lock "cinder-fd85e85c-782f-4f49-a5f0-2dc49fee894c-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:32 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-841ca497-6c91-4100-882b-2d39d9d08b7a tempest-VolumesActionsTest-281576991 None] Detaching volume fd85e85c-782f-4f49-a5f0-2dc49fee894c from instance 95c07f40-186a-4d85-9411-1e9d6c977f27. Feb 27 02:06:32 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-841ca497-6c91-4100-882b-2d39d9d08b7a tempest-VolumesActionsTest-281576991 None] Detach volume completed successfully. Feb 27 02:06:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-841ca497-6c91-4100-882b-2d39d9d08b7a tempest-VolumesActionsTest-281576991 None] Lock "cinder-fd85e85c-782f-4f49-a5f0-2dc49fee894c-detach_volume" released by "detach_volume" :: held 0.151s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:32 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2349f602-7a61-40b7-9001-173ecceb0f3a tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09 1G" returned: 0 in 0.786s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2349f602-7a61-40b7-9001-173ecceb0f3a tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:33 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09 Feb 27 02:06:33 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:33 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2349f602-7a61-40b7-9001-173ecceb0f3a tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09" returned: 0 in 0.783s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:33 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-2349f602-7a61-40b7-9001-173ecceb0f3a tempest-VolumesDeleteCascade-1226226648 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09 is being set with open permissions: ugo+rw Feb 27 02:06:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2349f602-7a61-40b7-9001-173ecceb0f3a tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:33 devstack sudo[87728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09 Feb 27 02:06:33 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:34 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2349f602-7a61-40b7-9001-173ecceb0f3a tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09" returned: 0 in 0.752s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2349f602-7a61-40b7-9001-173ecceb0f3a tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:34 devstack sudo[87758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.info Feb 27 02:06:34 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:34 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-bef56be0-5292-4e1a-9327-464824863e7b tempest-GroupSnapshotsTest-336945538 None] Group tempest-GroupSnapshotsTest-Group-1201049433: creating Feb 27 02:06:34 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-bef56be0-5292-4e1a-9327-464824863e7b tempest-GroupSnapshotsTest-336945538 None] Group tempest-GroupSnapshotsTest-Group-1201049433: created successfully Feb 27 02:06:34 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-bef56be0-5292-4e1a-9327-464824863e7b tempest-GroupSnapshotsTest-336945538 None] Create group completed successfully. Feb 27 02:06:35 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2349f602-7a61-40b7-9001-173ecceb0f3a tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.info" returned: 0 in 0.620s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:35 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-2349f602-7a61-40b7-9001-173ecceb0f3a tempest-VolumesDeleteCascade-1226226648 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.info is being set with open permissions: ugo+rw Feb 27 02:06:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2349f602-7a61-40b7-9001-173ecceb0f3a tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:35 devstack sudo[87794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.info Feb 27 02:06:35 devstack sudo[87794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:35 devstack sudo[87794]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2349f602-7a61-40b7-9001-173ecceb0f3a tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.info" returned: 0 in 0.592s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2349f602-7a61-40b7-9001-173ecceb0f3a tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.690s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:35 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2349f602-7a61-40b7-9001-173ecceb0f3a tempest-VolumesDeleteCascade-1226226648 None] Create snapshot completed successfully Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Flow 'volume_create_manager' (7166fc4a-c66e-45e6-b1c9-951e5f1a5aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3757727e-c1d9-4990-8694-4be46323ed34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3757727e-c1d9-4990-8694-4be46323ed34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1374776053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9e4f316d-aa9c-44ca-883e-1e218fb9270d,host='devstack@QuobyteHD#QuobyteHD',id=e31bd124-b9c0-4da9-9aed-1c28936c3155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26950d6c2dfd42fcacafe8f91bb26640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:36Z,use_quota=True,user_id='83a17d618ee644b485716877ed52abfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee1793d0-1963-49b5-9382-7ce09fca9bb3),volume_type_id=ee1793d0-1963-49b5-9382-7ce09fca9bb3)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5e45fc-f63d-4807-aaba-0206e5edb57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5e45fc-f63d-4807-aaba-0206e5edb57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4397bc2-4282-4bdf-8323-df2ce93790e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4397bc2-4282-4bdf-8323-df2ce93790e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e31bd124-b9c0-4da9-9aed-1c28936c3155', 'volume_name': 'volume-e31bd124-b9c0-4da9-9aed-1c28936c3155', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64836b1-caae-47a8-880f-71207989209b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64836b1-caae-47a8-880f-71207989209b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647747a3-91b0-49a8-beb7-a256277359f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:36 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Volume e31bd124-b9c0-4da9-9aed-1c28936c3155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e31bd124-b9c0-4da9-9aed-1c28936c3155', 'volume_size': 1} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9e4f316d-aa9c-44ca-883e-1e218fb9270d,created_at=2026-02-27T01:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1374776053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9e4f316d-aa9c-44ca-883e-1e218fb9270d,host='devstack@QuobyteHD#QuobyteHD',id=e31bd124-b9c0-4da9-9aed-1c28936c3155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26950d6c2dfd42fcacafe8f91bb26640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:36Z,use_quota=True,user_id='83a17d618ee644b485716877ed52abfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee1793d0-1963-49b5-9382-7ce09fca9bb3),volume_type_id=ee1793d0-1963-49b5-9382-7ce09fca9bb3)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Creating volume e31bd124-b9c0-4da9-9aed-1c28936c3155 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:36 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:36 devstack sudo[87801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 1073741824 Feb 27 02:06:36 devstack sudo[87801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Flow 'volume_create_manager' (b04e97e1-c6c3-4d58-8410-b9609490014b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f4f9a7-21fc-40a5-85f4-b0950b9e7979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f4f9a7-21fc-40a5-85f4-b0950b9e7979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-517539027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13bc1fd2-f9ae-4606-b024-2d665f6eaaa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26c5346d55be4ad98f5f3c5c6187865e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5ec02e5b-222d-457f-9165-b2d40b86ee09,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:37Z,use_quota=True,user_id='b10b67d85ac74d4bb206741e1c901815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738076bc-1e97-48c7-b0ea-913ae61a89b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738076bc-1e97-48c7-b0ea-913ae61a89b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (589f6173-9a4f-4d3b-8005-502ba4629b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (589f6173-9a4f-4d3b-8005-502ba4629b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '13bc1fd2-f9ae-4606-b024-2d665f6eaaa1', 'volume_name': 'volume-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1', 'volume_size': 1, 'snapshot_id': '5ec02e5b-222d-457f-9165-b2d40b86ee09'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3307f959-a431-4381-b74f-184b6f2f38e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3307f959-a431-4381-b74f-184b6f2f38e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2801b00-406b-4f37-976e-40460dbffd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:36 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Volume 13bc1fd2-f9ae-4606-b024-2d665f6eaaa1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1', 'volume_size': 1, 'snapshot_id': '5ec02e5b-222d-457f-9165-b2d40b86ee09'} Feb 27 02:06:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:37 devstack sudo[87801]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 1073741824" returned: 0 in 1.087s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:37 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 Feb 27 02:06:37 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:38 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155" returned: 0 in 0.712s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.324s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "cinder-quobyte-5ec02e5b-222d-457f-9165-b2d40b86ee09-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1" by "_create_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647747a3-91b0-49a8-beb7-a256277359f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e31bd124-b9c0-4da9-9aed-1c28936c3155', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec549c6-3262-4fbb-809a-b1145a14c3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-5ec02e5b-222d-457f-9165-b2d40b86ee09-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Creating volume 13bc1fd2-f9ae-4606-b024-2d665f6eaaa1 from snapshot 5ec02e5b-222d-457f-9165-b2d40b86ee09 {{(pid=83167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "cinder-quobyte-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:38 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Volume volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 (e31bd124-b9c0-4da9-9aed-1c28936c3155): created successfully Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec549c6-3262-4fbb-809a-b1145a14c3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Flow 'volume_create_manager' (7166fc4a-c66e-45e6-b1c9-951e5f1a5aa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] snapshot: 5ec02e5b-222d-457f-9165-b2d40b86ee09, volume: 13bc1fd2-f9ae-4606-b024-2d665f6eaaa1, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:06:38 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-443978d9-c4a4-48a9-9189-598f1e9b5ddb tempest-GroupSnapshotsTest-336945538 None] Created volume successfully. Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb1d173-dc9b-4bd2-aec0-6dbc9b476f80]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:38 devstack sudo[87811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09 Feb 27 02:06:38 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:38 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] GroupSnapshot 4596dc7c-7806-401a-a0ca-ca175c6b21d7: creating. Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] Group snapshot 4596dc7c-7806-401a-a0ca-ca175c6b21d7: creating. {{(pid=83167) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 02:06:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:39 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09" returned: 0 in 0.799s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:06:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:06:39 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[10381b5b-972c-4382-8fe3-4b69b428a45e]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:39 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb Feb 27 02:06:39 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:39 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb" returned: 0 in 0.672s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:39 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Path /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1 not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:06:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:39 devstack sudo[87821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1 Feb 27 02:06:39 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-19540d3f-fe6a-4c4c-856d-a8cc2d0e2268 tempest-VolumesActionsTest-281576991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:42 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1" returned: 0 in 2.832s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:42 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b308dd-6a04-466b-82b8-f8dd34cf7a06]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:42 devstack sudo[87847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb Feb 27 02:06:42 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:43 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb" returned: 0 in 0.740s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:43 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Image conversion details: src /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb, size 1024.00 MB, duration 2.83 sec, destination /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:06:43 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Converted 1024.00 MB image at 361.51 MB/s Feb 27 02:06:43 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1 is being set with open permissions: ugo+rw Feb 27 02:06:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:43 devstack sudo[87852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1 Feb 27 02:06:43 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:43 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1" returned: 0 in 0.417s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1" released by "_copy_volume_from_snapshot" :: held 5.606s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-5ec02e5b-222d-457f-9165-b2d40b86ee09-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1" released by "_create_volume_from_snapshot" :: held 5.645s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.683s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.154s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] Creating offline snapshot 437fe4bc-1ad8-4941-9d01-9c526dbf1336 of volume e31bd124-b9c0-4da9-9aed-1c28936c3155 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:06:43 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f639c94-98fe-432d-92b1-42547807180c]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2801b00-406b-4f37-976e-40460dbffd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1', 'volume_size': 1, 'snapshot_id': '5ec02e5b-222d-457f-9165-b2d40b86ee09'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b865e28-3059-49ef-a546-a76b2848319b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:43 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Volume volume-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1 (13bc1fd2-f9ae-4606-b024-2d665f6eaaa1): created successfully Feb 27 02:06:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b865e28-3059-49ef-a546-a76b2848319b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Flow 'volume_create_manager' (b04e97e1-c6c3-4d58-8410-b9609490014b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:44 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-0da375b4-a30c-4f45-b383-1c80fe99da0d tempest-VolumesDeleteCascade-1226226648 None] Created volume successfully. Feb 27 02:06:44 devstack sudo[87855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 Feb 27 02:06:44 devstack sudo[87855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "cinder-3f597944-110b-412f-bbe5-9e4dcd3bdbdb-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-3f597944-110b-412f-bbe5-9e4dcd3bdbdb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Performing cascade delete. {{(pid=83167) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 27 02:06:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "cinder-5ec02e5b-222d-457f-9165-b2d40b86ee09-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:44 devstack sudo[87855]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155" returned: 0 in 0.629s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-5ec02e5b-222d-457f-9165-b2d40b86ee09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:44 devstack sudo[87860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336 1G Feb 27 02:06:44 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "cinder-quobyte-3f597944-110b-412f-bbe5-9e4dcd3bdbdb" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-3f597944-110b-412f-bbe5-9e4dcd3bdbdb" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "cinder-quobyte-5ec02e5b-222d-457f-9165-b2d40b86ee09" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-5ec02e5b-222d-457f-9165-b2d40b86ee09" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Deleting offline snapshot 5ec02e5b-222d-457f-9165-b2d40b86ee09 of volume 3f597944-110b-412f-bbe5-9e4dcd3bdbdb {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:06:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] snapshot_file for this snap is: volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:06:44 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e6a562-f2e4-44d8-a0fb-83ddd118b498]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:44 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09 Feb 27 02:06:44 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:45 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336 1G" returned: 0 in 0.552s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:45 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336 Feb 27 02:06:45 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:45 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09" returned: 0 in 0.621s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80ebc7c-3422-4e5f-96ee-089e8673b569]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:45 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb Feb 27 02:06:45 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Flow 'volume_create_manager' (76e4610c-b2bb-4600-8e63-f8c2b1b004b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e576da4b-a25c-47f5-9ab6-77428335d0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e576da4b-a25c-47f5-9ab6-77428335d0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-897671322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914483e4-ca66-4c77-8b5c-a681b1303360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c8392d47d1847c3b85902d731acce4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:45Z,use_quota=True,user_id='9695486ecde548628fd0a8e56e34f618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9a2125-3864-4618-9969-16788a77dc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc9a2125-3864-4618-9969-16788a77dc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be3e9a0d-73ac-49c1-b8df-8e05d701fc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be3e9a0d-73ac-49c1-b8df-8e05d701fc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '914483e4-ca66-4c77-8b5c-a681b1303360', 'volume_name': 'volume-914483e4-ca66-4c77-8b5c-a681b1303360', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8360e630-c8b3-4d7e-b14f-e6a632015775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8360e630-c8b3-4d7e-b14f-e6a632015775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9bba83-8032-4048-a5d6-ce0c2c037d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:45 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Volume 914483e4-ca66-4c77-8b5c-a681b1303360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-914483e4-ca66-4c77-8b5c-a681b1303360', 'volume_size': 1} Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:45 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336" returned: 0 in 0.572s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:45 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:45 devstack sudo[87877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336 Feb 27 02:06:45 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:45 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb" returned: 0 in 0.523s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:45 devstack sudo[87882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09 Feb 27 02:06:45 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:46 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336" returned: 0 in 0.424s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:46 devstack sudo[87887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.info Feb 27 02:06:46 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:46 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09" returned: 0 in 0.451s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:46 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09 Feb 27 02:06:46 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:46 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.info" returned: 0 in 0.481s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:46 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:06:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:46 devstack sudo[87893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.info Feb 27 02:06:46 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:46 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb.5ec02e5b-222d-457f-9165-b2d40b86ee09" returned: 0 in 0.544s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-5ec02e5b-222d-457f-9165-b2d40b86ee09" released by "_delete_snapshot" :: held 2.192s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-3f597944-110b-412f-bbe5-9e4dcd3bdbdb" released by "delete_snapshot" :: held 2.207s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:46 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Created reservations ['7e2cf56f-cc6d-4a51-ae6e-dfc5ff891d9c', '25cf8f91-8648-4ff7-aa94-da391dad9a10', '8a1d9dc3-8f2a-49e0-9324-71ba0b93af8a', 'c4cb0f22-46e8-4201-a9c5-1cd8d5c64299'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:46 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Delete snapshot completed successfully. Feb 27 02:06:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-5ec02e5b-222d-457f-9165-b2d40b86ee09-delete_snapshot" released by "delete_snapshot" :: held 2.327s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Snapshots deleted, issuing volume delete {{(pid=83167) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 27 02:06:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "cinder-quobyte-3f597944-110b-412f-bbe5-9e4dcd3bdbdb" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-3f597944-110b-412f-bbe5-9e4dcd3bdbdb" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:46 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[169ffb59-2cf3-474c-81ca-1cdcb8681744]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:47 devstack sudo[87896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb Feb 27 02:06:47 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:47 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.info" returned: 0 in 0.429s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.151s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-19540d3f-fe6a-4c4c-856d-a8cc2d0e2268 tempest-VolumesActionsTest-281576991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 4.770s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:47 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2901d34-e3c6-4e92-adb0-284cdac0f493]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19540d3f-fe6a-4c4c-856d-a8cc2d0e2268 tempest-VolumesActionsTest-281576991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:47 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-22105bc4-1141-4b9a-99c3-1ebddd9657fe tempest-GroupSnapshotsTest-336945538 None] group_snapshot 4596dc7c-7806-401a-a0ca-ca175c6b21d7: created successfully Feb 27 02:06:47 devstack sudo[87899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c Feb 27 02:06:47 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:47 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb" returned: 0 in 0.550s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:47 devstack sudo[87904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb Feb 27 02:06:47 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:47 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19540d3f-fe6a-4c4c-856d-a8cc2d0e2268 tempest-VolumesActionsTest-281576991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c" returned: 0 in 0.610s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:47 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[eace5a8a-2124-4dbc-bc99-8a361ef9a2ce]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19540d3f-fe6a-4c4c-856d-a8cc2d0e2268 tempest-VolumesActionsTest-281576991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:47 devstack sudo[87910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c Feb 27 02:06:47 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:47 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3f597944-110b-412f-bbe5-9e4dcd3bdbdb" returned: 0 in 0.415s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-3f597944-110b-412f-bbe5-9e4dcd3bdbdb" released by "delete_volume" :: held 0.999s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:47 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Created reservations ['a64daf47-f965-42a4-a909-e0886aeb8efd', '260ce112-b9e8-419c-b6ae-6dba23c86d5f', '5ed6a45a-143e-456b-b931-f0ba4dc2d908', 'f83f697d-3ca0-4fe0-86d5-06ace5763031'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:48 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:06:48 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:48 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19540d3f-fe6a-4c4c-856d-a8cc2d0e2268 tempest-VolumesActionsTest-281576991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c" returned: 0 in 0.556s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19540d3f-fe6a-4c4c-856d-a8cc2d0e2268 tempest-VolumesActionsTest-281576991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c /opt/stack/data/cinder/conversion/fd85e85c-782f-4f49-a5f0-2dc49fee894c.temp_image.4bc960a0-2477-4320-b0a7-3b43d646759ejlfkps16.img {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:48 devstack sudo[87918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c /opt/stack/data/cinder/conversion/fd85e85c-782f-4f49-a5f0-2dc49fee894c.temp_image.4bc960a0-2477-4320-b0a7-3b43d646759ejlfkps16.img Feb 27 02:06:48 devstack sudo[87918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:48 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.462s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:48 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:48 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Deleted volume successfully. Feb 27 02:06:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ef458c7b-0d39-47ca-aa24-f6edd7177a3e tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-3f597944-110b-412f-bbe5-9e4dcd3bdbdb-delete_volume" released by "delete_volume" :: held 3.968s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cee6118f-0c6b-478f-9e21-01e18d00b032 tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "cinder-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cee6118f-0c6b-478f-9e21-01e18d00b032 tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cee6118f-0c6b-478f-9e21-01e18d00b032 tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "cinder-quobyte-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cee6118f-0c6b-478f-9e21-01e18d00b032 tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1" acquired by "delete_volume" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:49 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f091738-d7a6-4896-b1d3-a7329363f270]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cee6118f-0c6b-478f-9e21-01e18d00b032 tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:49 devstack sudo[87931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1 Feb 27 02:06:49 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:50 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cee6118f-0c6b-478f-9e21-01e18d00b032 tempest-VolumesDeleteCascade-1226226648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1" returned: 0 in 1.287s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cee6118f-0c6b-478f-9e21-01e18d00b032 tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:50 devstack sudo[87936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1 Feb 27 02:06:50 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:50 devstack sudo[87918]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19540d3f-fe6a-4c4c-856d-a8cc2d0e2268 tempest-VolumesActionsTest-281576991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c /opt/stack/data/cinder/conversion/fd85e85c-782f-4f49-a5f0-2dc49fee894c.temp_image.4bc960a0-2477-4320-b0a7-3b43d646759ejlfkps16.img" returned: 0 in 2.565s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:50 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[85acbe9a-959b-4d5d-8851-5eb910b56561]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19540d3f-fe6a-4c4c-856d-a8cc2d0e2268 tempest-VolumesActionsTest-281576991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:50 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c Feb 27 02:06:50 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:51 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cee6118f-0c6b-478f-9e21-01e18d00b032 tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1" returned: 0 in 0.617s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cee6118f-0c6b-478f-9e21-01e18d00b032 tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-quobyte-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1" released by "delete_volume" :: held 1.956s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:51 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:DELETE=18,cinder:SELECT=134,cinder:INSERT=43,cinder:UPDATE=158 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:06:51 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=150,cinder:INSERT=39,cinder:UPDATE=171,cinder:DELETE=10 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:06:51 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-cee6118f-0c6b-478f-9e21-01e18d00b032 tempest-VolumesDeleteCascade-1226226648 None] Created reservations ['d89447fa-acfd-4084-8073-e4d90365e08f', '230aace0-5bf5-41df-a8d5-53e8932593ec', 'cc09faa7-3aa3-4d99-9cbd-14ef5258c91f', '99974579-5035-4903-a989-ddf96c6ea2cd'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cee6118f-0c6b-478f-9e21-01e18d00b032 tempest-VolumesDeleteCascade-1226226648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cee6118f-0c6b-478f-9e21-01e18d00b032 tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cee6118f-0c6b-478f-9e21-01e18d00b032 tempest-VolumesDeleteCascade-1226226648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cee6118f-0c6b-478f-9e21-01e18d00b032 tempest-VolumesDeleteCascade-1226226648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cee6118f-0c6b-478f-9e21-01e18d00b032 tempest-VolumesDeleteCascade-1226226648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cee6118f-0c6b-478f-9e21-01e18d00b032 tempest-VolumesDeleteCascade-1226226648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:51 devstack sudo[87941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:06:51 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:51 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19540d3f-fe6a-4c4c-856d-a8cc2d0e2268 tempest-VolumesActionsTest-281576991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c" returned: 0 in 0.758s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:51 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-19540d3f-fe6a-4c4c-856d-a8cc2d0e2268 tempest-VolumesActionsTest-281576991 None] Image conversion details: src /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c, size 1024.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/conversion/fd85e85c-782f-4f49-a5f0-2dc49fee894c.temp_image.4bc960a0-2477-4320-b0a7-3b43d646759ejlfkps16.img {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:06:51 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-19540d3f-fe6a-4c4c-856d-a8cc2d0e2268 tempest-VolumesActionsTest-281576991 None] Converted 1024.00 MB image at 399.05 MB/s Feb 27 02:06:51 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-19540d3f-fe6a-4c4c-856d-a8cc2d0e2268 tempest-VolumesActionsTest-281576991 None] 4bc960a0-2477-4320-b0a7-3b43d646759e was raw, no need to convert to raw {{(pid=83167) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Feb 27 02:06:51 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cee6118f-0c6b-478f-9e21-01e18d00b032 tempest-VolumesDeleteCascade-1226226648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.595s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:51 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-cee6118f-0c6b-478f-9e21-01e18d00b032 tempest-VolumesDeleteCascade-1226226648 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:51 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-cee6118f-0c6b-478f-9e21-01e18d00b032 tempest-VolumesDeleteCascade-1226226648 None] Deleted volume successfully. Feb 27 02:06:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cee6118f-0c6b-478f-9e21-01e18d00b032 tempest-VolumesDeleteCascade-1226226648 None] Lock "cinder-13bc1fd2-f9ae-4606-b024-2d665f6eaaa1-delete_volume" released by "delete_volume" :: held 2.734s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:54 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Flow 'volume_create_manager' (dad10afb-230a-4c76-b60c-8939c3a44dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc87670-548c-43ba-a54b-1c27f8ca5ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc87670-548c-43ba-a54b-1c27f8ca5ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-756938278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a8ec919-e5a6-429d-a37d-83b2052eca7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8eab52389d14a26bcbe010ee219de26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:55Z,use_quota=True,user_id='5cce211cfc8b4763abcd7a097a4bf05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97503b80-62d0-4fe2-8ab7-5218083e84a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97503b80-62d0-4fe2-8ab7-5218083e84a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b4eee06-e415-4919-baa6-761f6ea7ed54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b4eee06-e415-4919-baa6-761f6ea7ed54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a8ec919-e5a6-429d-a37d-83b2052eca7f', 'volume_name': 'volume-8a8ec919-e5a6-429d-a37d-83b2052eca7f', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8db8ab1-b7f5-47a9-9e59-f0846ca84ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8db8ab1-b7f5-47a9-9e59-f0846ca84ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede671c7-ad88-4c47-917a-3560926059ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:55 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Volume 8a8ec919-e5a6-429d-a37d-83b2052eca7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a8ec919-e5a6-429d-a37d-83b2052eca7f', 'volume_size': 1} Feb 27 02:06:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-19540d3f-fe6a-4c4c-856d-a8cc2d0e2268 tempest-VolumesActionsTest-281576991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.407s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:02 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-19540d3f-fe6a-4c4c-856d-a8cc2d0e2268 tempest-VolumesActionsTest-281576991 None] Uploaded volume to glance image-id: 4bc960a0-2477-4320-b0a7-3b43d646759e. {{(pid=83167) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 27 02:07:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.899s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-897671322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914483e4-ca66-4c77-8b5c-a681b1303360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c8392d47d1847c3b85902d731acce4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:45Z,use_quota=True,user_id='9695486ecde548628fd0a8e56e34f618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Creating volume 914483e4-ca66-4c77-8b5c-a681b1303360 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:02 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:07:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-914483e4-ca66-4c77-8b5c-a681b1303360 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:02 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-914483e4-ca66-4c77-8b5c-a681b1303360 1073741824 Feb 27 02:07:02 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:02 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-19540d3f-fe6a-4c4c-856d-a8cc2d0e2268 tempest-VolumesActionsTest-281576991 None] Copy volume to image completed successfully. Feb 27 02:07:03 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-914483e4-ca66-4c77-8b5c-a681b1303360 1073741824" returned: 0 in 0.534s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-914483e4-ca66-4c77-8b5c-a681b1303360 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:03 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-914483e4-ca66-4c77-8b5c-a681b1303360 Feb 27 02:07:03 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:03 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-914483e4-ca66-4c77-8b5c-a681b1303360" returned: 0 in 0.511s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 15.158s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "cinder-quobyte-437fe4bc-1ad8-4941-9d01-9c526dbf1336-2bf2eaed-5b5e-4554-9362-8cc8fd262e72" by "_create_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9bba83-8032-4048-a5d6-ce0c2c037d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-914483e4-ca66-4c77-8b5c-a681b1303360', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532868cb-6362-47ef-9350-ff659b83665d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-437fe4bc-1ad8-4941-9d01-9c526dbf1336-2bf2eaed-5b5e-4554-9362-8cc8fd262e72" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Creating volume 2bf2eaed-5b5e-4554-9362-8cc8fd262e72 from snapshot 437fe4bc-1ad8-4941-9d01-9c526dbf1336 {{(pid=83167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "cinder-quobyte-2bf2eaed-5b5e-4554-9362-8cc8fd262e72" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:03 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Volume volume-914483e4-ca66-4c77-8b5c-a681b1303360 (914483e4-ca66-4c77-8b5c-a681b1303360): created successfully Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532868cb-6362-47ef-9350-ff659b83665d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Flow 'volume_create_manager' (76e4610c-b2bb-4600-8e63-f8c2b1b004b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-2bf2eaed-5b5e-4554-9362-8cc8fd262e72" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] snapshot: 437fe4bc-1ad8-4941-9d01-9c526dbf1336, volume: 2bf2eaed-5b5e-4554-9362-8cc8fd262e72, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:07:03 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7cf2ac57-adb9-4ba3-88a8-f6f7e1510761 tempest-VolumesTransfersTest-1795097832 None] Created volume successfully. Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29ab422-1bf6-4a4e-bf4b-3116dca0d43a]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:03 devstack sudo[87957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336 Feb 27 02:07:03 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:04 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336" returned: 0 in 0.482s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e31bd124-b9c0-4da9-9aed-1c28936c3155(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:07:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:07:04 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bec075f-562f-48f4-82c6-eb70ca7443c9]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:04 devstack sudo[87962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 Feb 27 02:07:04 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:04 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155" returned: 0 in 0.517s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:04 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Path /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2bf2eaed-5b5e-4554-9362-8cc8fd262e72 not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:07:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2bf2eaed-5b5e-4554-9362-8cc8fd262e72 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:04 devstack sudo[87967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2bf2eaed-5b5e-4554-9362-8cc8fd262e72 Feb 27 02:07:04 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:05 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f73580e7-b6c7-421a-bb81-5b74a980bd53 tempest-VolumesTransfersTest-1376830849 None] Transfer volume completed successfully. Feb 27 02:07:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cf91ce90-538a-4b64-ac91-246fc119627d tempest-VolumesTransfersTest-1031670803 None] Acquiring lock "cinder-914483e4-ca66-4c77-8b5c-a681b1303360-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cf91ce90-538a-4b64-ac91-246fc119627d tempest-VolumesTransfersTest-1031670803 None] Lock "cinder-914483e4-ca66-4c77-8b5c-a681b1303360-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cf91ce90-538a-4b64-ac91-246fc119627d tempest-VolumesTransfersTest-1031670803 None] Acquiring lock "cinder-quobyte-914483e4-ca66-4c77-8b5c-a681b1303360" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cf91ce90-538a-4b64-ac91-246fc119627d tempest-VolumesTransfersTest-1031670803 None] Lock "cinder-quobyte-914483e4-ca66-4c77-8b5c-a681b1303360" acquired by "delete_volume" :: waited 0.057s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:06 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4919fc1e-2227-4e20-b16d-73ed3094da62]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cf91ce90-538a-4b64-ac91-246fc119627d tempest-VolumesTransfersTest-1031670803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-914483e4-ca66-4c77-8b5c-a681b1303360 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:07 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-914483e4-ca66-4c77-8b5c-a681b1303360 Feb 27 02:07:07 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:07 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2bf2eaed-5b5e-4554-9362-8cc8fd262e72" returned: 0 in 2.824s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:07 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84bfa60-d74f-465f-81af-732001694e4c]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:07 devstack sudo[87981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 Feb 27 02:07:07 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:07 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cf91ce90-538a-4b64-ac91-246fc119627d tempest-VolumesTransfersTest-1031670803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-914483e4-ca66-4c77-8b5c-a681b1303360" returned: 0 in 0.949s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cf91ce90-538a-4b64-ac91-246fc119627d tempest-VolumesTransfersTest-1031670803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-914483e4-ca66-4c77-8b5c-a681b1303360 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:07 devstack sudo[87987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-914483e4-ca66-4c77-8b5c-a681b1303360 Feb 27 02:07:07 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:08 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155" returned: 0 in 0.654s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Image conversion details: src /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155, size 1024.00 MB, duration 2.82 sec, destination /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2bf2eaed-5b5e-4554-9362-8cc8fd262e72 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:07:08 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Converted 1024.00 MB image at 362.49 MB/s Feb 27 02:07:08 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2bf2eaed-5b5e-4554-9362-8cc8fd262e72 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2bf2eaed-5b5e-4554-9362-8cc8fd262e72 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:08 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2bf2eaed-5b5e-4554-9362-8cc8fd262e72 Feb 27 02:07:08 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:08 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cf91ce90-538a-4b64-ac91-246fc119627d tempest-VolumesTransfersTest-1031670803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-914483e4-ca66-4c77-8b5c-a681b1303360" returned: 0 in 0.433s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cf91ce90-538a-4b64-ac91-246fc119627d tempest-VolumesTransfersTest-1031670803 None] Lock "cinder-quobyte-914483e4-ca66-4c77-8b5c-a681b1303360" released by "delete_volume" :: held 1.462s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-cf91ce90-538a-4b64-ac91-246fc119627d tempest-VolumesTransfersTest-1031670803 None] Created reservations ['59a916dd-800b-4bec-a44a-25c5ca3509fd', '6cda6a05-497a-4d7d-9b23-c4c16799c7bc', 'c6585f09-37cc-41cf-ba6c-2b5c270e4b6d', 'bbed2df4-d22f-49ea-9cce-786375025043'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cf91ce90-538a-4b64-ac91-246fc119627d tempest-VolumesTransfersTest-1031670803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cf91ce90-538a-4b64-ac91-246fc119627d tempest-VolumesTransfersTest-1031670803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cf91ce90-538a-4b64-ac91-246fc119627d tempest-VolumesTransfersTest-1031670803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cf91ce90-538a-4b64-ac91-246fc119627d tempest-VolumesTransfersTest-1031670803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cf91ce90-538a-4b64-ac91-246fc119627d tempest-VolumesTransfersTest-1031670803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cf91ce90-538a-4b64-ac91-246fc119627d tempest-VolumesTransfersTest-1031670803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:08 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:07:08 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:08 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2bf2eaed-5b5e-4554-9362-8cc8fd262e72" returned: 0 in 0.570s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-2bf2eaed-5b5e-4554-9362-8cc8fd262e72" released by "_copy_volume_from_snapshot" :: held 5.107s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-437fe4bc-1ad8-4941-9d01-9c526dbf1336-2bf2eaed-5b5e-4554-9362-8cc8fd262e72" released by "_create_volume_from_snapshot" :: held 5.134s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.153s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.644s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-756938278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a8ec919-e5a6-429d-a37d-83b2052eca7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8eab52389d14a26bcbe010ee219de26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:55Z,use_quota=True,user_id='5cce211cfc8b4763abcd7a097a4bf05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Creating volume 8a8ec919-e5a6-429d-a37d-83b2052eca7f {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:08 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8a8ec919-e5a6-429d-a37d-83b2052eca7f 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:08 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8a8ec919-e5a6-429d-a37d-83b2052eca7f 1073741824 Feb 27 02:07:08 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:08 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1772f035-30c6-4e07-a515-14d056cf66bf tempest-GroupSnapshotsTest-336945538 None] Create group from source-snapshot-4596dc7c-7806-401a-a0ca-ca175c6b21d7 completed successfully. Feb 27 02:07:08 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cf91ce90-538a-4b64-ac91-246fc119627d tempest-VolumesTransfersTest-1031670803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.471s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-cf91ce90-538a-4b64-ac91-246fc119627d tempest-VolumesTransfersTest-1031670803 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:08 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-cf91ce90-538a-4b64-ac91-246fc119627d tempest-VolumesTransfersTest-1031670803 None] Deleted volume successfully. Feb 27 02:07:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cf91ce90-538a-4b64-ac91-246fc119627d tempest-VolumesTransfersTest-1031670803 None] Lock "cinder-914483e4-ca66-4c77-8b5c-a681b1303360-delete_volume" released by "delete_volume" :: held 2.223s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:09 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8a8ec919-e5a6-429d-a37d-83b2052eca7f 1073741824" returned: 0 in 0.629s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Flow 'volume_create_manager' (5b8dc414-aa59-4db5-b89f-f6e68f54bbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd1c401-909f-42b6-8818-85c7176984d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd1c401-909f-42b6-8818-85c7176984d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1479190688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a104e3b-58a1-472b-bc7a-00175fcb267e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c8392d47d1847c3b85902d731acce4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:09Z,use_quota=True,user_id='9695486ecde548628fd0a8e56e34f618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22033d51-184c-4c9c-934b-83dc76abfa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22033d51-184c-4c9c-934b-83dc76abfa3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870daef0-e36b-4f6a-a0d8-da3740364492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870daef0-e36b-4f6a-a0d8-da3740364492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a104e3b-58a1-472b-bc7a-00175fcb267e', 'volume_name': 'volume-4a104e3b-58a1-472b-bc7a-00175fcb267e', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b613f5b1-eb3d-4227-ac56-0dc7339cf35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b613f5b1-eb3d-4227-ac56-0dc7339cf35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e7c48a-17d1-4906-9ea7-da5934454621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:09 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Volume 4a104e3b-58a1-472b-bc7a-00175fcb267e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a104e3b-58a1-472b-bc7a-00175fcb267e', 'volume_size': 1} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8a8ec919-e5a6-429d-a37d-83b2052eca7f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:09 devstack sudo[88004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8a8ec919-e5a6-429d-a37d-83b2052eca7f Feb 27 02:07:09 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-392bc136-b2a0-4871-bfd7-12209981a00d tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "cinder-quobyte-2bf2eaed-5b5e-4554-9362-8cc8fd262e72" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-392bc136-b2a0-4871-bfd7-12209981a00d tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-2bf2eaed-5b5e-4554-9362-8cc8fd262e72" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3c5185-e0af-449f-84a2-b988e3fa877a]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-392bc136-b2a0-4871-bfd7-12209981a00d tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2bf2eaed-5b5e-4554-9362-8cc8fd262e72 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:09 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8a8ec919-e5a6-429d-a37d-83b2052eca7f" returned: 0 in 0.511s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 6.500s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede671c7-ad88-4c47-917a-3560926059ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a8ec919-e5a6-429d-a37d-83b2052eca7f', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66bcbfe-17b4-49e5-82eb-acc78e59d31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:09 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f8cb37-baa5-4cf9-8299-84315015f00f]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:10 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2bf2eaed-5b5e-4554-9362-8cc8fd262e72 Feb 27 02:07:10 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:10 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Volume volume-8a8ec919-e5a6-429d-a37d-83b2052eca7f (8a8ec919-e5a6-429d-a37d-83b2052eca7f): created successfully Feb 27 02:07:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66bcbfe-17b4-49e5-82eb-acc78e59d31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Flow 'volume_create_manager' (dad10afb-230a-4c76-b60c-8939c3a44dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:10 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-499cdbc6-09d6-4f5d-a2f0-f85ceeb2daf8 tempest-VolumesTransfersV357Test-1848677689 None] Created volume successfully. Feb 27 02:07:10 devstack sudo[88009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c Feb 27 02:07:10 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:10 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-392bc136-b2a0-4871-bfd7-12209981a00d tempest-GroupSnapshotsTest-336945538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2bf2eaed-5b5e-4554-9362-8cc8fd262e72" returned: 0 in 0.588s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-392bc136-b2a0-4871-bfd7-12209981a00d tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2bf2eaed-5b5e-4554-9362-8cc8fd262e72 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:10 devstack sudo[88014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2bf2eaed-5b5e-4554-9362-8cc8fd262e72 Feb 27 02:07:10 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:10 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c" returned: 0 in 0.731s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:10 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9163b8dd-3e77-40a1-aa18-a29e2fe9cb7d]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:10 devstack sudo[88019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c Feb 27 02:07:10 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:11 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-392bc136-b2a0-4871-bfd7-12209981a00d tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2bf2eaed-5b5e-4554-9362-8cc8fd262e72" returned: 0 in 0.598s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-392bc136-b2a0-4871-bfd7-12209981a00d tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-2bf2eaed-5b5e-4554-9362-8cc8fd262e72" released by "delete_volume" :: held 1.229s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:11 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-392bc136-b2a0-4871-bfd7-12209981a00d tempest-GroupSnapshotsTest-336945538 None] Created reservations ['51cca998-be73-4b91-83a6-c15a59f1eab1'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:11 devstack cinder-volume[83167]: WARNING cinder.quota [None req-392bc136-b2a0-4871-bfd7-12209981a00d tempest-GroupSnapshotsTest-336945538 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-900069836 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-900069836, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:07:11 devstack cinder-volume[83167]: WARNING cinder.quota [None req-392bc136-b2a0-4871-bfd7-12209981a00d tempest-GroupSnapshotsTest-336945538 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-900069836 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-900069836, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:07:11 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-392bc136-b2a0-4871-bfd7-12209981a00d tempest-GroupSnapshotsTest-336945538 None] Created reservations ['9301bbc9-a340-4d42-b377-4db242f312b8', '38d7ef8f-e1ba-4f60-b354-437dec288fdd', 'f71aa23a-ea49-4126-901c-6e48bae663fe', '30b164c7-ecd1-479f-b2ec-e39b1d1ea7d1'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-392bc136-b2a0-4871-bfd7-12209981a00d tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-392bc136-b2a0-4871-bfd7-12209981a00d tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-392bc136-b2a0-4871-bfd7-12209981a00d tempest-GroupSnapshotsTest-336945538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-392bc136-b2a0-4871-bfd7-12209981a00d tempest-GroupSnapshotsTest-336945538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-392bc136-b2a0-4871-bfd7-12209981a00d tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-392bc136-b2a0-4871-bfd7-12209981a00d tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:11 devstack sudo[88025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:07:11 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:11 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c" returned: 0 in 0.772s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c /opt/stack/data/cinder/conversion/fd85e85c-782f-4f49-a5f0-2dc49fee894c.temp_image.6a3fb3e7-43b4-43b6-9486-c7e403d9092bubuop5l5.img {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:11 devstack sudo[88027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c /opt/stack/data/cinder/conversion/fd85e85c-782f-4f49-a5f0-2dc49fee894c.temp_image.6a3fb3e7-43b4-43b6-9486-c7e403d9092bubuop5l5.img Feb 27 02:07:11 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:11 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ab128880-1f8b-403d-a192-2e3ec500ac43 tempest-VolumesTransfersV357Test-101338204 None] Transfer volume completed successfully. Feb 27 02:07:11 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-392bc136-b2a0-4871-bfd7-12209981a00d tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.603s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:11 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-392bc136-b2a0-4871-bfd7-12209981a00d tempest-GroupSnapshotsTest-336945538 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:11 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-392bc136-b2a0-4871-bfd7-12209981a00d tempest-GroupSnapshotsTest-336945538 None] Delete group completed successfully. Feb 27 02:07:12 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] group_snapshot 4596dc7c-7806-401a-a0ca-ca175c6b21d7: deleting Feb 27 02:07:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] group_snapshot 4596dc7c-7806-401a-a0ca-ca175c6b21d7: deleting {{(pid=83167) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 02:07:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "cinder-quobyte-e31bd124-b9c0-4da9-9aed-1c28936c3155" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-e31bd124-b9c0-4da9-9aed-1c28936c3155" acquired by "delete_snapshot" :: waited 0.032s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "cinder-quobyte-437fe4bc-1ad8-4941-9d01-9c526dbf1336" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-437fe4bc-1ad8-4941-9d01-9c526dbf1336" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] Deleting offline snapshot 437fe4bc-1ad8-4941-9d01-9c526dbf1336 of volume e31bd124-b9c0-4da9-9aed-1c28936c3155 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] snapshot_file for this snap is: volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:12 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bc874e-70a9-47e7-b4d9-283b6ec3493f]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:12 devstack sudo[88040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336 Feb 27 02:07:12 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a47069e6-b5f1-4078-8e0d-4e4f3e51b92a tempest-VolumesTransfersV357Test-1527020363 None] Acquiring lock "cinder-8a8ec919-e5a6-429d-a37d-83b2052eca7f-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a47069e6-b5f1-4078-8e0d-4e4f3e51b92a tempest-VolumesTransfersV357Test-1527020363 None] Lock "cinder-8a8ec919-e5a6-429d-a37d-83b2052eca7f-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a47069e6-b5f1-4078-8e0d-4e4f3e51b92a tempest-VolumesTransfersV357Test-1527020363 None] Acquiring lock "cinder-quobyte-8a8ec919-e5a6-429d-a37d-83b2052eca7f" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a47069e6-b5f1-4078-8e0d-4e4f3e51b92a tempest-VolumesTransfersV357Test-1527020363 None] Lock "cinder-quobyte-8a8ec919-e5a6-429d-a37d-83b2052eca7f" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:13 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ff1cd0-95bc-4051-b096-d6191fdc5cf9]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a47069e6-b5f1-4078-8e0d-4e4f3e51b92a tempest-VolumesTransfersV357Test-1527020363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8a8ec919-e5a6-429d-a37d-83b2052eca7f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:13 devstack sudo[88042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8a8ec919-e5a6-429d-a37d-83b2052eca7f Feb 27 02:07:13 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:14 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336" returned: 0 in 1.903s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e31bd124-b9c0-4da9-9aed-1c28936c3155(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:14 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ea4aad-e699-4871-b039-daa3bd0720e1]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:14 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 Feb 27 02:07:14 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:14 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c /opt/stack/data/cinder/conversion/fd85e85c-782f-4f49-a5f0-2dc49fee894c.temp_image.6a3fb3e7-43b4-43b6-9486-c7e403d9092bubuop5l5.img" returned: 0 in 3.021s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:14 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0671343b-a2a6-4fe0-a8d3-3f83f325d78f]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:14 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c Feb 27 02:07:14 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:14 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a47069e6-b5f1-4078-8e0d-4e4f3e51b92a tempest-VolumesTransfersV357Test-1527020363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8a8ec919-e5a6-429d-a37d-83b2052eca7f" returned: 0 in 1.224s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a47069e6-b5f1-4078-8e0d-4e4f3e51b92a tempest-VolumesTransfersV357Test-1527020363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8a8ec919-e5a6-429d-a37d-83b2052eca7f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:14 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8a8ec919-e5a6-429d-a37d-83b2052eca7f Feb 27 02:07:14 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:15 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155" returned: 0 in 0.729s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:15 devstack sudo[88063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336 Feb 27 02:07:15 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:15 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a47069e6-b5f1-4078-8e0d-4e4f3e51b92a tempest-VolumesTransfersV357Test-1527020363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8a8ec919-e5a6-429d-a37d-83b2052eca7f" returned: 0 in 0.558s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:15 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a47069e6-b5f1-4078-8e0d-4e4f3e51b92a tempest-VolumesTransfersV357Test-1527020363 None] Lock "cinder-quobyte-8a8ec919-e5a6-429d-a37d-83b2052eca7f" released by "delete_volume" :: held 1.877s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c" returned: 0 in 0.775s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:15 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] Image conversion details: src /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c, size 1024.00 MB, duration 3.02 sec, destination /opt/stack/data/cinder/conversion/fd85e85c-782f-4f49-a5f0-2dc49fee894c.temp_image.6a3fb3e7-43b4-43b6-9486-c7e403d9092bubuop5l5.img {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:07:15 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] Converted 1024.00 MB image at 338.71 MB/s Feb 27 02:07:15 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] 6a3fb3e7-43b4-43b6-9486-c7e403d9092b was raw, converting to qcow2 {{(pid=83167) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Feb 27 02:07:15 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-a47069e6-b5f1-4078-8e0d-4e4f3e51b92a tempest-VolumesTransfersV357Test-1527020363 None] Created reservations ['2e3d3bf1-0775-48c1-ae8d-8a9431374eb9', '1428a42c-03ef-42ed-b63a-ff8526d5172d', 'a581b14b-4f9c-4a07-bdbe-55e28603eb78', '219f54dc-e826-4b5a-8037-1b18bb5b9f76'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:15 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07e6577-d35c-424a-9090-bec2ab9cf89b]: (4, 'raw') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fd85e85c-782f-4f49-a5f0-2dc49fee894c.temp_image.6a3fb3e7-43b4-43b6-9486-c7e403d9092bubuop5l5.img {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a47069e6-b5f1-4078-8e0d-4e4f3e51b92a tempest-VolumesTransfersV357Test-1527020363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a47069e6-b5f1-4078-8e0d-4e4f3e51b92a tempest-VolumesTransfersV357Test-1527020363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a47069e6-b5f1-4078-8e0d-4e4f3e51b92a tempest-VolumesTransfersV357Test-1527020363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a47069e6-b5f1-4078-8e0d-4e4f3e51b92a tempest-VolumesTransfersV357Test-1527020363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a47069e6-b5f1-4078-8e0d-4e4f3e51b92a tempest-VolumesTransfersV357Test-1527020363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a47069e6-b5f1-4078-8e0d-4e4f3e51b92a tempest-VolumesTransfersV357Test-1527020363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:15 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:07:15 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:15 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fd85e85c-782f-4f49-a5f0-2dc49fee894c.temp_image.6a3fb3e7-43b4-43b6-9486-c7e403d9092bubuop5l5.img Feb 27 02:07:15 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:15 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336" returned: 0 in 0.665s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:15 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336 Feb 27 02:07:15 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:16 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Flow 'volume_create_manager' (ffdd4c6a-603b-4fe2-8d98-c0351ae1161e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6aafc85-5ca0-4947-8a86-3b452220b898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:16 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a47069e6-b5f1-4078-8e0d-4e4f3e51b92a tempest-VolumesTransfersV357Test-1527020363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.660s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-a47069e6-b5f1-4078-8e0d-4e4f3e51b92a tempest-VolumesTransfersV357Test-1527020363 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fd85e85c-782f-4f49-a5f0-2dc49fee894c.temp_image.6a3fb3e7-43b4-43b6-9486-c7e403d9092bubuop5l5.img" returned: 0 in 0.758s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fd85e85c-782f-4f49-a5f0-2dc49fee894c.temp_image.6a3fb3e7-43b4-43b6-9486-c7e403d9092bubuop5l5.img {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:16 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a47069e6-b5f1-4078-8e0d-4e4f3e51b92a tempest-VolumesTransfersV357Test-1527020363 None] Deleted volume successfully. Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6aafc85-5ca0-4947-8a86-3b452220b898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-800633215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e53924-6dea-434e-afa5-1d01bf6c09df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8eab52389d14a26bcbe010ee219de26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:16Z,use_quota=True,user_id='5cce211cfc8b4763abcd7a097a4bf05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670c6ad4-4b9a-4add-92f8-6ff0d36f0d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670c6ad4-4b9a-4add-92f8-6ff0d36f0d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9137777-e0f0-4b5f-9b33-146182b42fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9137777-e0f0-4b5f-9b33-146182b42fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47e53924-6dea-434e-afa5-1d01bf6c09df', 'volume_name': 'volume-47e53924-6dea-434e-afa5-1d01bf6c09df', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1619412a-e924-47ef-a152-1304d6329e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1619412a-e924-47ef-a152-1304d6329e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f652455-0101-4b62-b04e-c4391b04ab17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:16 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Volume 47e53924-6dea-434e-afa5-1d01bf6c09df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47e53924-6dea-434e-afa5-1d01bf6c09df', 'volume_size': 1} Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a47069e6-b5f1-4078-8e0d-4e4f3e51b92a tempest-VolumesTransfersV357Test-1527020363 None] Lock "cinder-8a8ec919-e5a6-429d-a37d-83b2052eca7f-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:16 devstack sudo[88080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fd85e85c-782f-4f49-a5f0-2dc49fee894c.temp_image.6a3fb3e7-43b4-43b6-9486-c7e403d9092bubuop5l5.img Feb 27 02:07:16 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:16 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155.437fe4bc-1ad8-4941-9d01-9c526dbf1336" returned: 0 in 0.607s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-437fe4bc-1ad8-4941-9d01-9c526dbf1336" released by "_delete_snapshot" :: held 4.023s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-e31bd124-b9c0-4da9-9aed-1c28936c3155" released by "delete_snapshot" :: held 4.052s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:16 devstack cinder-volume[83167]: WARNING cinder.quota [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-900069836 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-900069836, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] Created reservations ['32479c70-f1ef-4827-8135-16178ed60380', '36bb7530-9e89-4317-860c-b7a7e898b956', 'a2068414-c82c-4732-8aa3-99db9db18438', '322919e7-5a3c-4c91-9653-a893c962418b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:16 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-cb3c7ad8-c26a-45a0-942d-b5311a7fac52 tempest-GroupSnapshotsTest-336945538 None] group_snapshot 4596dc7c-7806-401a-a0ca-ca175c6b21d7: deleted successfully Feb 27 02:07:16 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fd85e85c-782f-4f49-a5f0-2dc49fee894c.temp_image.6a3fb3e7-43b4-43b6-9486-c7e403d9092bubuop5l5.img" returned: 1 in 0.557s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fd85e85c-782f-4f49-a5f0-2dc49fee894c.temp_image.6a3fb3e7-43b4-43b6-9486-c7e403d9092bubuop5l5.img' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fd85e85c-782f-4f49-a5f0-2dc49fee894c.temp_image.6a3fb3e7-43b4-43b6-9486-c7e403d9092bubuop5l5.img /opt/stack/data/cinder/conversion/vol_upload_fkryownl {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:16 devstack sudo[88086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fd85e85c-782f-4f49-a5f0-2dc49fee894c.temp_image.6a3fb3e7-43b4-43b6-9486-c7e403d9092bubuop5l5.img /opt/stack/data/cinder/conversion/vol_upload_fkryownl Feb 27 02:07:16 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a17ad8bd-a862-443c-a591-125f1690f5c1 tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "cinder-quobyte-e31bd124-b9c0-4da9-9aed-1c28936c3155" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a17ad8bd-a862-443c-a591-125f1690f5c1 tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-e31bd124-b9c0-4da9-9aed-1c28936c3155" acquired by "delete_volume" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2c3aa6-e6b0-493d-85ac-39a8799f444b]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a17ad8bd-a862-443c-a591-125f1690f5c1 tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:17 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 Feb 27 02:07:17 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:17 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fd85e85c-782f-4f49-a5f0-2dc49fee894c.temp_image.6a3fb3e7-43b4-43b6-9486-c7e403d9092bubuop5l5.img /opt/stack/data/cinder/conversion/vol_upload_fkryownl" returned: 0 in 0.607s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:17 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] Image conversion details: src /opt/stack/data/cinder/conversion/fd85e85c-782f-4f49-a5f0-2dc49fee894c.temp_image.6a3fb3e7-43b4-43b6-9486-c7e403d9092bubuop5l5.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_fkryownl {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:07:17 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] Converted 1024.00 MB image at 1024.00 MB/s Feb 27 02:07:17 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5623dc49-3251-4d65-912d-d0f4db7f9ed0]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fkryownl {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:17 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fkryownl Feb 27 02:07:17 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:17 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a17ad8bd-a862-443c-a591-125f1690f5c1 tempest-GroupSnapshotsTest-336945538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155" returned: 0 in 0.560s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a17ad8bd-a862-443c-a591-125f1690f5c1 tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:17 devstack sudo[88098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155 Feb 27 02:07:17 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:17 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fkryownl" returned: 0 in 0.482s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:18 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a17ad8bd-a862-443c-a591-125f1690f5c1 tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e31bd124-b9c0-4da9-9aed-1c28936c3155" returned: 0 in 0.531s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a17ad8bd-a862-443c-a591-125f1690f5c1 tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-e31bd124-b9c0-4da9-9aed-1c28936c3155" released by "delete_volume" :: held 1.137s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-a17ad8bd-a862-443c-a591-125f1690f5c1 tempest-GroupSnapshotsTest-336945538 None] Created reservations ['b6017268-c4dd-4be5-a307-f52ab15999f2'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:18 devstack cinder-volume[83167]: WARNING cinder.db.sqlalchemy.api [None req-a17ad8bd-a862-443c-a591-125f1690f5c1 tempest-GroupSnapshotsTest-336945538 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-900069836'] Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-a17ad8bd-a862-443c-a591-125f1690f5c1 tempest-GroupSnapshotsTest-336945538 None] Created reservations ['d745a962-367f-46f2-b28d-e507ccf5ce63', 'f34fabc2-8068-44b0-b53a-67717d8e61bc', '05e9e8f8-b0bd-46af-ab20-35af2fbf81db', 'ef8a6c38-2200-4d63-9895-d9a3124e5e19'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a17ad8bd-a862-443c-a591-125f1690f5c1 tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a17ad8bd-a862-443c-a591-125f1690f5c1 tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a17ad8bd-a862-443c-a591-125f1690f5c1 tempest-GroupSnapshotsTest-336945538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a17ad8bd-a862-443c-a591-125f1690f5c1 tempest-GroupSnapshotsTest-336945538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a17ad8bd-a862-443c-a591-125f1690f5c1 tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a17ad8bd-a862-443c-a591-125f1690f5c1 tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:18 devstack sudo[88105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:07:18 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.773s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] Uploaded volume to glance image-id: 6a3fb3e7-43b4-43b6-9486-c7e403d9092b. {{(pid=83167) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.318s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1479190688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a104e3b-58a1-472b-bc7a-00175fcb267e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c8392d47d1847c3b85902d731acce4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:09Z,use_quota=True,user_id='9695486ecde548628fd0a8e56e34f618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Creating volume 4a104e3b-58a1-472b-bc7a-00175fcb267e {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:18 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4a104e3b-58a1-472b-bc7a-00175fcb267e 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:18 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8801780e-25b1-4042-b666-7d547bedeb8f tempest-VolumesActionsTest-281576991 None] Copy volume to image completed successfully. Feb 27 02:07:18 devstack sudo[88108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4a104e3b-58a1-472b-bc7a-00175fcb267e 1073741824 Feb 27 02:07:18 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:18 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a17ad8bd-a862-443c-a591-125f1690f5c1 tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.497s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:18 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-a17ad8bd-a862-443c-a591-125f1690f5c1 tempest-GroupSnapshotsTest-336945538 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:18 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a17ad8bd-a862-443c-a591-125f1690f5c1 tempest-GroupSnapshotsTest-336945538 None] Delete group completed successfully. Feb 27 02:07:19 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:19 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d2712022-c9b3-480f-9d49-bd5fff63f0c7 tempest-GroupSnapshotsTest-336945538 None] Group tempest-GroupSnapshotsTest-Group-1351518505: creating Feb 27 02:07:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4a104e3b-58a1-472b-bc7a-00175fcb267e 1073741824" returned: 0 in 0.769s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4a104e3b-58a1-472b-bc7a-00175fcb267e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:19 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d2712022-c9b3-480f-9d49-bd5fff63f0c7 tempest-GroupSnapshotsTest-336945538 None] Group tempest-GroupSnapshotsTest-Group-1351518505: created successfully Feb 27 02:07:19 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4a104e3b-58a1-472b-bc7a-00175fcb267e Feb 27 02:07:19 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:19 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d2712022-c9b3-480f-9d49-bd5fff63f0c7 tempest-GroupSnapshotsTest-336945538 None] Create group completed successfully. Feb 27 02:07:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1c4832a6-0cfc-4253-ba18-99a630929d67 tempest-VolumesActionsTest-281576991 None] Acquiring lock "cinder-fd85e85c-782f-4f49-a5f0-2dc49fee894c-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1c4832a6-0cfc-4253-ba18-99a630929d67 tempest-VolumesActionsTest-281576991 None] Lock "cinder-fd85e85c-782f-4f49-a5f0-2dc49fee894c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1c4832a6-0cfc-4253-ba18-99a630929d67 tempest-VolumesActionsTest-281576991 None] Acquiring lock "cinder-quobyte-fd85e85c-782f-4f49-a5f0-2dc49fee894c" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1c4832a6-0cfc-4253-ba18-99a630929d67 tempest-VolumesActionsTest-281576991 None] Lock "cinder-quobyte-fd85e85c-782f-4f49-a5f0-2dc49fee894c" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:19 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[093edfd8-952b-4670-b8eb-1ad983b86b40]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1c4832a6-0cfc-4253-ba18-99a630929d67 tempest-VolumesActionsTest-281576991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:20 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c Feb 27 02:07:20 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:20 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4a104e3b-58a1-472b-bc7a-00175fcb267e" returned: 0 in 0.495s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.898s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-800633215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e53924-6dea-434e-afa5-1d01bf6c09df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8eab52389d14a26bcbe010ee219de26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:16Z,use_quota=True,user_id='5cce211cfc8b4763abcd7a097a4bf05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Creating volume 47e53924-6dea-434e-afa5-1d01bf6c09df {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:20 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-47e53924-6dea-434e-afa5-1d01bf6c09df 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e7c48a-17d1-4906-9ea7-da5934454621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a104e3b-58a1-472b-bc7a-00175fcb267e', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:20 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-47e53924-6dea-434e-afa5-1d01bf6c09df 1073741824 Feb 27 02:07:20 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858d7b0f-2120-48ee-8aee-e46d88e5e80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:20 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Volume volume-4a104e3b-58a1-472b-bc7a-00175fcb267e (4a104e3b-58a1-472b-bc7a-00175fcb267e): created successfully Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858d7b0f-2120-48ee-8aee-e46d88e5e80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Flow 'volume_create_manager' (5b8dc414-aa59-4db5-b89f-f6e68f54bbb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:20 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-26e041f7-1dd6-4aec-9895-82cf5c1cc79c tempest-VolumesTransfersTest-1795097832 None] Created volume successfully. Feb 27 02:07:20 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1c4832a6-0cfc-4253-ba18-99a630929d67 tempest-VolumesActionsTest-281576991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c" returned: 0 in 0.524s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1c4832a6-0cfc-4253-ba18-99a630929d67 tempest-VolumesActionsTest-281576991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:20 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c Feb 27 02:07:20 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:20 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-47e53924-6dea-434e-afa5-1d01bf6c09df 1073741824" returned: 0 in 0.734s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-47e53924-6dea-434e-afa5-1d01bf6c09df {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:20 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-47e53924-6dea-434e-afa5-1d01bf6c09df Feb 27 02:07:20 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Flow 'volume_create_manager' (e5fb0985-875d-4ac5-a818-3bfe358acf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c164cf-3f19-42db-b984-a8405b24bba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c164cf-3f19-42db-b984-a8405b24bba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-592926997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=060b03e2-06e2-481f-9129-32c9c28e385b,host='devstack@QuobyteHD#QuobyteHD',id=7cdb0553-5fb5-492b-91bb-1c9deda5db14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26950d6c2dfd42fcacafe8f91bb26640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:21Z,use_quota=True,user_id='83a17d618ee644b485716877ed52abfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e30ba-3c3a-4745-b5dd-a13a712b9c8b),volume_type_id=903e30ba-3c3a-4745-b5dd-a13a712b9c8b)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:20 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57535e27-8009-425a-9543-2f892ff6e9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57535e27-8009-425a-9543-2f892ff6e9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97527bc-1173-4ce9-8742-79f93349dc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97527bc-1173-4ce9-8742-79f93349dc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cdb0553-5fb5-492b-91bb-1c9deda5db14', 'volume_name': 'volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6a4f3f-c46c-4d68-9621-09ccd70de8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6a4f3f-c46c-4d68-9621-09ccd70de8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09211876-18c9-45c5-b32c-6c470737bd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:21 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Volume 7cdb0553-5fb5-492b-91bb-1c9deda5db14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14', 'volume_size': 1} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:21 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1c4832a6-0cfc-4253-ba18-99a630929d67 tempest-VolumesActionsTest-281576991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-fd85e85c-782f-4f49-a5f0-2dc49fee894c" returned: 0 in 0.606s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1c4832a6-0cfc-4253-ba18-99a630929d67 tempest-VolumesActionsTest-281576991 None] Lock "cinder-quobyte-fd85e85c-782f-4f49-a5f0-2dc49fee894c" released by "delete_volume" :: held 1.154s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-1c4832a6-0cfc-4253-ba18-99a630929d67 tempest-VolumesActionsTest-281576991 None] Created reservations ['a8c00b14-f9e4-4a01-839a-664717067a5e', '1b0d6c2a-d097-4226-a408-556d3a60cb1b', 'bb226901-adb0-4cb4-bcad-cff30b5e9053', 'e151ab20-ed67-42dd-aaea-a3db61d12d0b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1c4832a6-0cfc-4253-ba18-99a630929d67 tempest-VolumesActionsTest-281576991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1c4832a6-0cfc-4253-ba18-99a630929d67 tempest-VolumesActionsTest-281576991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1c4832a6-0cfc-4253-ba18-99a630929d67 tempest-VolumesActionsTest-281576991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1c4832a6-0cfc-4253-ba18-99a630929d67 tempest-VolumesActionsTest-281576991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1c4832a6-0cfc-4253-ba18-99a630929d67 tempest-VolumesActionsTest-281576991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1c4832a6-0cfc-4253-ba18-99a630929d67 tempest-VolumesActionsTest-281576991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:21 devstack sudo[88131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:07:21 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:21 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-47e53924-6dea-434e-afa5-1d01bf6c09df" returned: 0 in 0.580s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.423s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=060b03e2-06e2-481f-9129-32c9c28e385b,created_at=2026-02-27T01:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-592926997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=060b03e2-06e2-481f-9129-32c9c28e385b,host='devstack@QuobyteHD#QuobyteHD',id=7cdb0553-5fb5-492b-91bb-1c9deda5db14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26950d6c2dfd42fcacafe8f91bb26640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:21Z,use_quota=True,user_id='83a17d618ee644b485716877ed52abfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e30ba-3c3a-4745-b5dd-a13a712b9c8b),volume_type_id=903e30ba-3c3a-4745-b5dd-a13a712b9c8b)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Creating volume 7cdb0553-5fb5-492b-91bb-1c9deda5db14 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:21 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f652455-0101-4b62-b04e-c4391b04ab17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47e53924-6dea-434e-afa5-1d01bf6c09df', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ba27a0-e240-4d4a-971d-fa102c143b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:21 devstack sudo[88134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14 1073741824 Feb 27 02:07:21 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:21 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Volume volume-47e53924-6dea-434e-afa5-1d01bf6c09df (47e53924-6dea-434e-afa5-1d01bf6c09df): created successfully Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ba27a0-e240-4d4a-971d-fa102c143b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Flow 'volume_create_manager' (ffdd4c6a-603b-4fe2-8d98-c0351ae1161e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:21 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-81d77a38-0658-4738-819c-b954f2bdfcb5 tempest-VolumesTransfersV357Test-1848677689 None] Created volume successfully. Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1e8db7f4-3e4a-414f-9cfa-4de6054e907a tempest-VolumesTransfersTest-1031670803 None] Acquiring lock "cinder-4a104e3b-58a1-472b-bc7a-00175fcb267e-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1e8db7f4-3e4a-414f-9cfa-4de6054e907a tempest-VolumesTransfersTest-1031670803 None] Lock "cinder-4a104e3b-58a1-472b-bc7a-00175fcb267e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1e8db7f4-3e4a-414f-9cfa-4de6054e907a tempest-VolumesTransfersTest-1031670803 None] Acquiring lock "cinder-quobyte-4a104e3b-58a1-472b-bc7a-00175fcb267e" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1e8db7f4-3e4a-414f-9cfa-4de6054e907a tempest-VolumesTransfersTest-1031670803 None] Lock "cinder-quobyte-4a104e3b-58a1-472b-bc7a-00175fcb267e" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cc221f-adbd-4b34-971e-43f01b01c850]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1e8db7f4-3e4a-414f-9cfa-4de6054e907a tempest-VolumesTransfersTest-1031670803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4a104e3b-58a1-472b-bc7a-00175fcb267e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:21 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4a104e3b-58a1-472b-bc7a-00175fcb267e Feb 27 02:07:21 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:21 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1c4832a6-0cfc-4253-ba18-99a630929d67 tempest-VolumesActionsTest-281576991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.586s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-1c4832a6-0cfc-4253-ba18-99a630929d67 tempest-VolumesActionsTest-281576991 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:21 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1c4832a6-0cfc-4253-ba18-99a630929d67 tempest-VolumesActionsTest-281576991 None] Deleted volume successfully. Feb 27 02:07:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1c4832a6-0cfc-4253-ba18-99a630929d67 tempest-VolumesActionsTest-281576991 None] Lock "cinder-fd85e85c-782f-4f49-a5f0-2dc49fee894c-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:22 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14 1073741824" returned: 0 in 0.575s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:22 devstack sudo[88142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14 Feb 27 02:07:22 devstack sudo[88142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:22 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1e8db7f4-3e4a-414f-9cfa-4de6054e907a tempest-VolumesTransfersTest-1031670803 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4a104e3b-58a1-472b-bc7a-00175fcb267e" returned: 0 in 0.657s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1e8db7f4-3e4a-414f-9cfa-4de6054e907a tempest-VolumesTransfersTest-1031670803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4a104e3b-58a1-472b-bc7a-00175fcb267e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:22 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4a104e3b-58a1-472b-bc7a-00175fcb267e Feb 27 02:07:22 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:22 devstack sudo[88142]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14" returned: 0 in 0.567s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09211876-18c9-45c5-b32c-6c470737bd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de76a0ff-518b-4120-8b04-3e228327e2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Volume volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14 (7cdb0553-5fb5-492b-91bb-1c9deda5db14): created successfully Feb 27 02:07:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de76a0ff-518b-4120-8b04-3e228327e2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:22 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Flow 'volume_create_manager' (e5fb0985-875d-4ac5-a818-3bfe358acf0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:22 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-37c35d82-e797-409f-bee2-65acb8a5c42a tempest-GroupSnapshotsTest-336945538 None] Created volume successfully. Feb 27 02:07:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-072e0e54-73d8-4c67-8bab-81ba24cf5d6a tempest-VolumesTransfersV357Test-1527020363 None] Acquiring lock "cinder-47e53924-6dea-434e-afa5-1d01bf6c09df-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:22 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1e8db7f4-3e4a-414f-9cfa-4de6054e907a tempest-VolumesTransfersTest-1031670803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4a104e3b-58a1-472b-bc7a-00175fcb267e" returned: 0 in 0.540s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-072e0e54-73d8-4c67-8bab-81ba24cf5d6a tempest-VolumesTransfersV357Test-1527020363 None] Lock "cinder-47e53924-6dea-434e-afa5-1d01bf6c09df-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1e8db7f4-3e4a-414f-9cfa-4de6054e907a tempest-VolumesTransfersTest-1031670803 None] Lock "cinder-quobyte-4a104e3b-58a1-472b-bc7a-00175fcb267e" released by "delete_volume" :: held 1.245s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-072e0e54-73d8-4c67-8bab-81ba24cf5d6a tempest-VolumesTransfersV357Test-1527020363 None] Acquiring lock "cinder-quobyte-47e53924-6dea-434e-afa5-1d01bf6c09df" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-072e0e54-73d8-4c67-8bab-81ba24cf5d6a tempest-VolumesTransfersV357Test-1527020363 None] Lock "cinder-quobyte-47e53924-6dea-434e-afa5-1d01bf6c09df" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:22 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bfaaed-69af-4a94-b1ae-e675fbae7ff1]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-072e0e54-73d8-4c67-8bab-81ba24cf5d6a tempest-VolumesTransfersV357Test-1527020363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-47e53924-6dea-434e-afa5-1d01bf6c09df {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:22 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-1e8db7f4-3e4a-414f-9cfa-4de6054e907a tempest-VolumesTransfersTest-1031670803 None] Created reservations ['bd7b6632-6eaa-412f-b5df-c552ca6ae506', '6026f9e9-19f0-476b-b17a-4d9286117bb2', 'b640f63c-befc-481a-9f3a-bc4a6740d7e9', 'fe604b75-d65e-4e43-993a-6a525a5182fc'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1e8db7f4-3e4a-414f-9cfa-4de6054e907a tempest-VolumesTransfersTest-1031670803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1e8db7f4-3e4a-414f-9cfa-4de6054e907a tempest-VolumesTransfersTest-1031670803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1e8db7f4-3e4a-414f-9cfa-4de6054e907a tempest-VolumesTransfersTest-1031670803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1e8db7f4-3e4a-414f-9cfa-4de6054e907a tempest-VolumesTransfersTest-1031670803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1e8db7f4-3e4a-414f-9cfa-4de6054e907a tempest-VolumesTransfersTest-1031670803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1e8db7f4-3e4a-414f-9cfa-4de6054e907a tempest-VolumesTransfersTest-1031670803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:23 devstack sudo[88152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-47e53924-6dea-434e-afa5-1d01bf6c09df Feb 27 02:07:23 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:23 devstack sudo[88153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:07:23 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:23 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Flow 'volume_create_manager' (4b8cade3-01b3-4906-998a-c5039bfb22ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e771d2b-ee12-48d3-a4e6-a260155537bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-072e0e54-73d8-4c67-8bab-81ba24cf5d6a tempest-VolumesTransfersV357Test-1527020363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-47e53924-6dea-434e-afa5-1d01bf6c09df" returned: 0 in 0.737s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-072e0e54-73d8-4c67-8bab-81ba24cf5d6a tempest-VolumesTransfersV357Test-1527020363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-47e53924-6dea-434e-afa5-1d01bf6c09df {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:23 devstack sudo[88161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-47e53924-6dea-434e-afa5-1d01bf6c09df Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e771d2b-ee12-48d3-a4e6-a260155537bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1366101745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=060b03e2-06e2-481f-9129-32c9c28e385b,host='devstack@QuobyteHD#QuobyteHD',id=185df93c-202c-47c6-8a52-3b7288e4a4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26950d6c2dfd42fcacafe8f91bb26640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:24Z,use_quota=True,user_id='83a17d618ee644b485716877ed52abfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e30ba-3c3a-4745-b5dd-a13a712b9c8b),volume_type_id=903e30ba-3c3a-4745-b5dd-a13a712b9c8b)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:23 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75caf41b-bec6-48f4-9bf1-1260695f7d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75caf41b-bec6-48f4-9bf1-1260695f7d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f53a43-3027-43f7-a0f5-71aad4934880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f53a43-3027-43f7-a0f5-71aad4934880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '185df93c-202c-47c6-8a52-3b7288e4a4b3', 'volume_name': 'volume-185df93c-202c-47c6-8a52-3b7288e4a4b3', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caa993be-b7b2-4287-ab3d-fca1773a09b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caa993be-b7b2-4287-ab3d-fca1773a09b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9dcac9-e976-4199-a3d6-930ad2a1f683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:23 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Volume 185df93c-202c-47c6-8a52-3b7288e4a4b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-185df93c-202c-47c6-8a52-3b7288e4a4b3', 'volume_size': 1} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=060b03e2-06e2-481f-9129-32c9c28e385b,created_at=2026-02-27T01:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1366101745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=060b03e2-06e2-481f-9129-32c9c28e385b,host='devstack@QuobyteHD#QuobyteHD',id=185df93c-202c-47c6-8a52-3b7288e4a4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26950d6c2dfd42fcacafe8f91bb26640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:24Z,use_quota=True,user_id='83a17d618ee644b485716877ed52abfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(903e30ba-3c3a-4745-b5dd-a13a712b9c8b),volume_type_id=903e30ba-3c3a-4745-b5dd-a13a712b9c8b)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Creating volume 185df93c-202c-47c6-8a52-3b7288e4a4b3 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:23 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:23 devstack sudo[88163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3 1073741824 Feb 27 02:07:23 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:23 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1e8db7f4-3e4a-414f-9cfa-4de6054e907a tempest-VolumesTransfersTest-1031670803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.781s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-1e8db7f4-3e4a-414f-9cfa-4de6054e907a tempest-VolumesTransfersTest-1031670803 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:23 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1e8db7f4-3e4a-414f-9cfa-4de6054e907a tempest-VolumesTransfersTest-1031670803 None] Deleted volume successfully. Feb 27 02:07:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1e8db7f4-3e4a-414f-9cfa-4de6054e907a tempest-VolumesTransfersTest-1031670803 None] Lock "cinder-4a104e3b-58a1-472b-bc7a-00175fcb267e-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:24 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-072e0e54-73d8-4c67-8bab-81ba24cf5d6a tempest-VolumesTransfersV357Test-1527020363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-47e53924-6dea-434e-afa5-1d01bf6c09df" returned: 0 in 0.629s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:24 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-072e0e54-73d8-4c67-8bab-81ba24cf5d6a tempest-VolumesTransfersV357Test-1527020363 None] Lock "cinder-quobyte-47e53924-6dea-434e-afa5-1d01bf6c09df" released by "delete_volume" :: held 1.393s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:24 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-072e0e54-73d8-4c67-8bab-81ba24cf5d6a tempest-VolumesTransfersV357Test-1527020363 None] Created reservations ['223b0b8d-6606-4079-877c-4f5d8d62b0d7', '211f1aeb-d5c1-46af-862d-0c70080e515b', 'e1fe159c-7782-4da9-9153-2f827514b0a1', '86030b7f-16d7-490d-8eac-2c10b90f92f1'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-072e0e54-73d8-4c67-8bab-81ba24cf5d6a tempest-VolumesTransfersV357Test-1527020363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-072e0e54-73d8-4c67-8bab-81ba24cf5d6a tempest-VolumesTransfersV357Test-1527020363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-072e0e54-73d8-4c67-8bab-81ba24cf5d6a tempest-VolumesTransfersV357Test-1527020363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-072e0e54-73d8-4c67-8bab-81ba24cf5d6a tempest-VolumesTransfersV357Test-1527020363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-072e0e54-73d8-4c67-8bab-81ba24cf5d6a tempest-VolumesTransfersV357Test-1527020363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-072e0e54-73d8-4c67-8bab-81ba24cf5d6a tempest-VolumesTransfersV357Test-1527020363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:24 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3 1073741824" returned: 0 in 0.765s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:24 devstack sudo[88169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:07:24 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:24 devstack sudo[88171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3 Feb 27 02:07:24 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:25 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-072e0e54-73d8-4c67-8bab-81ba24cf5d6a tempest-VolumesTransfersV357Test-1527020363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:25 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-072e0e54-73d8-4c67-8bab-81ba24cf5d6a tempest-VolumesTransfersV357Test-1527020363 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:25 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-072e0e54-73d8-4c67-8bab-81ba24cf5d6a tempest-VolumesTransfersV357Test-1527020363 None] Deleted volume successfully. Feb 27 02:07:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-072e0e54-73d8-4c67-8bab-81ba24cf5d6a tempest-VolumesTransfersV357Test-1527020363 None] Lock "cinder-47e53924-6dea-434e-afa5-1d01bf6c09df-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:25 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3" returned: 0 in 0.645s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9dcac9-e976-4199-a3d6-930ad2a1f683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-185df93c-202c-47c6-8a52-3b7288e4a4b3', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98436939-7514-44d0-b88d-149f14af97eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:25 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Volume volume-185df93c-202c-47c6-8a52-3b7288e4a4b3 (185df93c-202c-47c6-8a52-3b7288e4a4b3): created successfully Feb 27 02:07:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98436939-7514-44d0-b88d-149f14af97eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:25 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Flow 'volume_create_manager' (4b8cade3-01b3-4906-998a-c5039bfb22ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:25 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-168dda2b-4d56-4a00-bf3b-ce5551a1e825 tempest-GroupSnapshotsTest-336945538 None] Created volume successfully. Feb 27 02:07:26 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-23e8a781-1a80-45b7-a975-e74617ed7206 tempest-GroupSnapshotsTest-336945538 None] Update group completed successfully. Feb 27 02:07:27 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f2f84c1b-ed20-45ae-aa2e-2bafafab9b81 tempest-GroupSnapshotsTest-336945538 None] Update group completed successfully. Feb 27 02:07:28 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-4829f801-4380-4df8-85a0-b9cd3464e087 tempest-GroupSnapshotsTest-336945538 None] Update group completed successfully. Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Flow 'volume_create_manager' (87b1b817-3555-4028-81b1-ead076591b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767966e1-6de8-412d-bfb1-68d7490282e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767966e1-6de8-412d-bfb1-68d7490282e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-165606916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f004aa-e114-4d80-84b6-87e939e23394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5964b08eade44fad9095b88e59a10707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:29Z,use_quota=True,user_id='b09a13fd35964a908b7af8c41962b5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49fdd4d-cbc6-4315-8362-3599a7e02ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49fdd4d-cbc6-4315-8362-3599a7e02ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288f5f04-af85-494e-8229-bf72aa70355a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288f5f04-af85-494e-8229-bf72aa70355a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97f004aa-e114-4d80-84b6-87e939e23394', 'volume_name': 'volume-97f004aa-e114-4d80-84b6-87e939e23394', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890e76f0-21ab-44a2-84b7-1ad307e7e77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890e76f0-21ab-44a2-84b7-1ad307e7e77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce544ab-2205-4fda-93fc-f656598e3e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:28 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Volume 97f004aa-e114-4d80-84b6-87e939e23394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97f004aa-e114-4d80-84b6-87e939e23394', 'volume_size': 1} Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-165606916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f004aa-e114-4d80-84b6-87e939e23394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5964b08eade44fad9095b88e59a10707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:29Z,use_quota=True,user_id='b09a13fd35964a908b7af8c41962b5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Creating volume 97f004aa-e114-4d80-84b6-87e939e23394 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:28 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:07:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:28 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 1073741824 Feb 27 02:07:28 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:29 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Flow 'volume_create_manager' (8d6944fd-4b95-4a70-9e46-0753360e5744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e062c487-aaa2-407d-8967-030a58a6fcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e062c487-aaa2-407d-8967-030a58a6fcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1809148308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d9049be-3b97-4417-bd90-1b83e4fe0575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f037fd3cda4d2d99fe39cff51bd713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:29Z,use_quota=True,user_id='59f2442ab0034fe0998265203a975a06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51220790-0db4-4a50-a275-d3d6baa55589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51220790-0db4-4a50-a275-d3d6baa55589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90dd215a-13d5-42cd-8cbf-6c74b5a43313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90dd215a-13d5-42cd-8cbf-6c74b5a43313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d9049be-3b97-4417-bd90-1b83e4fe0575', 'volume_name': 'volume-8d9049be-3b97-4417-bd90-1b83e4fe0575', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e29f58-7734-4918-9e5c-2c0d3676a688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e29f58-7734-4918-9e5c-2c0d3676a688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7e3ad2-2549-4353-a966-4a53e0cf7ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:29 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Volume 8d9049be-3b97-4417-bd90-1b83e4fe0575: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d9049be-3b97-4417-bd90-1b83e4fe0575', 'volume_size': 1} Feb 27 02:07:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:29 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 1073741824" returned: 0 in 0.818s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:29 devstack sudo[88182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 Feb 27 02:07:29 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:29 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-dfe46cc7-6341-4121-8cce-5d6f7532abe2 tempest-GroupSnapshotsTest-336945538 None] Update group completed successfully. Feb 27 02:07:30 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394" returned: 0 in 0.630s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.841s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1809148308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d9049be-3b97-4417-bd90-1b83e4fe0575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f037fd3cda4d2d99fe39cff51bd713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:29Z,use_quota=True,user_id='59f2442ab0034fe0998265203a975a06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Creating volume 8d9049be-3b97-4417-bd90-1b83e4fe0575 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:30 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce544ab-2205-4fda-93fc-f656598e3e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97f004aa-e114-4d80-84b6-87e939e23394', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e407caa-142f-4e72-a318-b405ebf74e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:30 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 1073741824 Feb 27 02:07:30 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:30 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Volume volume-97f004aa-e114-4d80-84b6-87e939e23394 (97f004aa-e114-4d80-84b6-87e939e23394): created successfully Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e407caa-142f-4e72-a318-b405ebf74e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Flow 'volume_create_manager' (87b1b817-3555-4028-81b1-ead076591b81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:30 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-17a38aef-289f-4762-88b8-a930b721899d tempest-VolumeDependencyTests-60775104 None] Created volume successfully. Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:30 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 1073741824" returned: 0 in 0.754s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:30 devstack sudo[88190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:07:30 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:31 devstack sudo[88192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 Feb 27 02:07:31 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Flow 'volume_create_manager' (aac3f6ef-6ae9-4bbe-9141-73da6860c3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b8bd92-3f33-432a-bd72-48a902a64cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b8bd92-3f33-432a-bd72-48a902a64cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1773193494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe5b159-59f1-4a8f-97e1-517788dbb8b4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='685e2444897d429193184e9f49490718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:31Z,use_quota=True,user_id='e9e12fd490fc489fa63cd0f9a7be422e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7afea1e-2266-4791-ae9a-bf0fab49695d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7afea1e-2266-4791-ae9a-bf0fab49695d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6ea960-ff45-41da-a003-2836ae581b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6ea960-ff45-41da-a003-2836ae581b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fe5b159-59f1-4a8f-97e1-517788dbb8b4', 'volume_name': 'volume-0fe5b159-59f1-4a8f-97e1-517788dbb8b4', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568ac11e-3c0d-4fb9-a5a1-00e3924f7cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568ac11e-3c0d-4fb9-a5a1-00e3924f7cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775e939a-b9d8-4444-ab94-46942dbcc1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:31 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Volume 0fe5b159-59f1-4a8f-97e1-517788dbb8b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fe5b159-59f1-4a8f-97e1-517788dbb8b4', 'volume_size': 1} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:31 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] GroupSnapshot 3fcf0b23-7848-4b4a-aab2-403a9c1ac3d0: creating. Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3afaf934-c434-45e2-8716-caee8b73cc5c tempest-VolumeDependencyTests-60775104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Group snapshot 3fcf0b23-7848-4b4a-aab2-403a9c1ac3d0: creating. {{(pid=83167) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:31 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.595s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:31 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575" returned: 0 in 0.741s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.345s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1773193494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe5b159-59f1-4a8f-97e1-517788dbb8b4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='685e2444897d429193184e9f49490718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:31Z,use_quota=True,user_id='e9e12fd490fc489fa63cd0f9a7be422e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Creating volume 0fe5b159-59f1-4a8f-97e1-517788dbb8b4 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:31 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0fe5b159-59f1-4a8f-97e1-517788dbb8b4 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7e3ad2-2549-4353-a966-4a53e0cf7ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d9049be-3b97-4417-bd90-1b83e4fe0575', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3000ca7-7b16-4ca4-8810-3aa06170d1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:31 devstack sudo[88197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0fe5b159-59f1-4a8f-97e1-517788dbb8b4 1073741824 Feb 27 02:07:31 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:31 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Volume volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 (8d9049be-3b97-4417-bd90-1b83e4fe0575): created successfully Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3000ca7-7b16-4ca4-8810-3aa06170d1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Flow 'volume_create_manager' (8d6944fd-4b95-4a70-9e46-0753360e5744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:31 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a49bf585-d10d-41bc-b3e6-a99008d913ba tempest-VolumesCloneTest-1568589259 None] Created volume successfully. Feb 27 02:07:32 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0fe5b159-59f1-4a8f-97e1-517788dbb8b4 1073741824" returned: 0 in 0.617s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0fe5b159-59f1-4a8f-97e1-517788dbb8b4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:32 devstack sudo[88202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0fe5b159-59f1-4a8f-97e1-517788dbb8b4 Feb 27 02:07:32 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:32 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0fe5b159-59f1-4a8f-97e1-517788dbb8b4" returned: 0 in 0.459s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3afaf934-c434-45e2-8716-caee8b73cc5c tempest-VolumeDependencyTests-60775104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.440s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775e939a-b9d8-4444-ab94-46942dbcc1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe5b159-59f1-4a8f-97e1-517788dbb8b4', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13abf742-fa7e-40ae-92f3-2152d387ec1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:32 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Volume volume-0fe5b159-59f1-4a8f-97e1-517788dbb8b4 (0fe5b159-59f1-4a8f-97e1-517788dbb8b4): created successfully Feb 27 02:07:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13abf742-fa7e-40ae-92f3-2152d387ec1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Flow 'volume_create_manager' (aac3f6ef-6ae9-4bbe-9141-73da6860c3c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-3afaf934-c434-45e2-8716-caee8b73cc5c tempest-VolumeDependencyTests-60775104 None] Creating offline snapshot 9872097e-6cb5-4392-af5f-01a6fe2b5e13 of volume 97f004aa-e114-4d80-84b6-87e939e23394 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:32 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-5b0dd35f-b5fd-4cd9-84ae-9b0adb4c5025 tempest-VolumesListTestJSON-194557610 None] Created volume successfully. Feb 27 02:07:32 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:32 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae3baa9-d1f7-4f2f-917c-48ebcf8ea9bd]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3afaf934-c434-45e2-8716-caee8b73cc5c tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Flow 'volume_create_manager' (c96e8c83-ea72-4ca8-aeff-206485c46f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fafbd99-500e-444b-a9b6-83e8c4d24977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fafbd99-500e-444b-a9b6-83e8c4d24977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1303318316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c117c35-0a89-4764-9c63-b62d99707350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7f037fd3cda4d2d99fe39cff51bd713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=8d9049be-3b97-4417-bd90-1b83e4fe0575,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:33Z,use_quota=True,user_id='59f2442ab0034fe0998265203a975a06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (149d7603-ce38-4cd6-a36e-87135001c6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (149d7603-ce38-4cd6-a36e-87135001c6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e236ff3-22f0-426c-ba1a-94c7152d785b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e236ff3-22f0-426c-ba1a-94c7152d785b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1c117c35-0a89-4764-9c63-b62d99707350', 'volume_name': 'volume-1c117c35-0a89-4764-9c63-b62d99707350', 'volume_size': 2, 'source_volid': '8d9049be-3b97-4417-bd90-1b83e4fe0575', 'source_volstatus': 'available'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62b8c33-e3a3-48b7-8d94-40d1c2443538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62b8c33-e3a3-48b7-8d94-40d1c2443538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca529069-d0c9-46db-a5b3-1384539b0f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:33 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Volume 1c117c35-0a89-4764-9c63-b62d99707350: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1c117c35-0a89-4764-9c63-b62d99707350', 'volume_size': 2, 'source_volid': '8d9049be-3b97-4417-bd90-1b83e4fe0575', 'source_volstatus': 'available'} Feb 27 02:07:33 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 Feb 27 02:07:33 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:33 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3afaf934-c434-45e2-8716-caee8b73cc5c tempest-VolumeDependencyTests-60775104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394" returned: 0 in 0.594s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3afaf934-c434-45e2-8716-caee8b73cc5c tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:33 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13 1G Feb 27 02:07:33 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Flow 'volume_create_manager' (b1746979-aad5-470a-a46f-82cfe5bcc221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f476ccd-95f0-422f-8299-4144eb917888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f476ccd-95f0-422f-8299-4144eb917888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-869685158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e03d5f5-3aca-4add-acd2-7b8d75526356,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='685e2444897d429193184e9f49490718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:34Z,use_quota=True,user_id='e9e12fd490fc489fa63cd0f9a7be422e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f06dca-4c6f-438b-a55c-da5143e41075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f06dca-4c6f-438b-a55c-da5143e41075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277f625c-fb58-491d-93e2-73cbef8240b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277f625c-fb58-491d-93e2-73cbef8240b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e03d5f5-3aca-4add-acd2-7b8d75526356', 'volume_name': 'volume-9e03d5f5-3aca-4add-acd2-7b8d75526356', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (748f0af1-adc5-40a8-a9d9-6436eb45119b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (748f0af1-adc5-40a8-a9d9-6436eb45119b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979e59fe-0046-47c8-81a4-530765632176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:33 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Volume 9e03d5f5-3aca-4add-acd2-7b8d75526356: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e03d5f5-3aca-4add-acd2-7b8d75526356', 'volume_size': 1} Feb 27 02:07:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:34 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3afaf934-c434-45e2-8716-caee8b73cc5c tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13 1G" returned: 0 in 0.767s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3afaf934-c434-45e2-8716-caee8b73cc5c tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97f004aa-e114-4d80-84b6-87e939e23394 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:34 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97f004aa-e114-4d80-84b6-87e939e23394 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13 Feb 27 02:07:34 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:34 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3afaf934-c434-45e2-8716-caee8b73cc5c tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97f004aa-e114-4d80-84b6-87e939e23394 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13" returned: 0 in 0.550s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:34 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-3afaf934-c434-45e2-8716-caee8b73cc5c tempest-VolumeDependencyTests-60775104 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13 is being set with open permissions: ugo+rw Feb 27 02:07:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3afaf934-c434-45e2-8716-caee8b73cc5c tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:34 devstack sudo[88226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13 Feb 27 02:07:34 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:35 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3afaf934-c434-45e2-8716-caee8b73cc5c tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13" returned: 0 in 0.512s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3afaf934-c434-45e2-8716-caee8b73cc5c tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:35 devstack sudo[88261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.info Feb 27 02:07:35 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:35 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3afaf934-c434-45e2-8716-caee8b73cc5c tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.info" returned: 0 in 0.547s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:35 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-3afaf934-c434-45e2-8716-caee8b73cc5c tempest-VolumeDependencyTests-60775104 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.info is being set with open permissions: ugo+rw Feb 27 02:07:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3afaf934-c434-45e2-8716-caee8b73cc5c tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:36 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.info Feb 27 02:07:36 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:36 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3afaf934-c434-45e2-8716-caee8b73cc5c tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.info" returned: 0 in 0.504s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3afaf934-c434-45e2-8716-caee8b73cc5c tempest-VolumeDependencyTests-60775104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.611s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.047s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Creating offline snapshot 3f1ed46c-100e-4de7-82c4-f77e43e50fc2 of volume 185df93c-202c-47c6-8a52-3b7288e4a4b3 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:36 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3afaf934-c434-45e2-8716-caee8b73cc5c tempest-VolumeDependencyTests-60775104 None] Create snapshot completed successfully Feb 27 02:07:36 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b67ad2-03ce-4ebf-8bc4-8247f6a3ab10]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:36 devstack sudo[88269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3 Feb 27 02:07:36 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:37 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3" returned: 0 in 0.505s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.3f1ed46c-100e-4de7-82c4-f77e43e50fc2 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:37 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.3f1ed46c-100e-4de7-82c4-f77e43e50fc2 1G Feb 27 02:07:37 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:37 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.3f1ed46c-100e-4de7-82c4-f77e43e50fc2 1G" returned: 0 in 0.595s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-185df93c-202c-47c6-8a52-3b7288e4a4b3 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.3f1ed46c-100e-4de7-82c4-f77e43e50fc2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:37 devstack sudo[88279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-185df93c-202c-47c6-8a52-3b7288e4a4b3 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.3f1ed46c-100e-4de7-82c4-f77e43e50fc2 Feb 27 02:07:37 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:37 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Flow 'volume_create_manager' (e9416b19-e69b-4351-b8b2-2c8955f5cb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46635eac-75d9-4edc-901b-d0a8bc76ac82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46635eac-75d9-4edc-901b-d0a8bc76ac82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-218716625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d34bf79-de57-41f7-a310-013f8f1bf960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5964b08eade44fad9095b88e59a10707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9872097e-6cb5-4392-af5f-01a6fe2b5e13,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:38Z,use_quota=True,user_id='b09a13fd35964a908b7af8c41962b5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af5369a-3f46-4d3e-82b1-3125c0ac9b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af5369a-3f46-4d3e-82b1-3125c0ac9b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df06cbb-7ab9-4a91-b8ab-b327b70f15b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df06cbb-7ab9-4a91-b8ab-b327b70f15b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0d34bf79-de57-41f7-a310-013f8f1bf960', 'volume_name': 'volume-0d34bf79-de57-41f7-a310-013f8f1bf960', 'volume_size': 1, 'snapshot_id': '9872097e-6cb5-4392-af5f-01a6fe2b5e13'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313f005a-16b2-4ae2-8149-16c17a5062da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313f005a-16b2-4ae2-8149-16c17a5062da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0a8b60-9d1e-44e1-8068-aee19452df23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:37 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Volume 0d34bf79-de57-41f7-a310-013f8f1bf960: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0d34bf79-de57-41f7-a310-013f8f1bf960', 'volume_size': 1, 'snapshot_id': '9872097e-6cb5-4392-af5f-01a6fe2b5e13'} Feb 27 02:07:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:38 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-185df93c-202c-47c6-8a52-3b7288e4a4b3 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.3f1ed46c-100e-4de7-82c4-f77e43e50fc2" returned: 0 in 0.555s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:38 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.3f1ed46c-100e-4de7-82c4-f77e43e50fc2 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:07:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.3f1ed46c-100e-4de7-82c4-f77e43e50fc2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:38 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.3f1ed46c-100e-4de7-82c4-f77e43e50fc2 Feb 27 02:07:38 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:38 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.3f1ed46c-100e-4de7-82c4-f77e43e50fc2" returned: 0 in 0.445s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:38 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.info Feb 27 02:07:38 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:39 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.info" returned: 0 in 0.703s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:39 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:07:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:39 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.info Feb 27 02:07:39 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:40 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.info" returned: 0 in 0.643s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.535s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Creating offline snapshot 79b5e59c-c2bd-43e2-8160-253a3bf1ba3e of volume 7cdb0553-5fb5-492b-91bb-1c9deda5db14 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:40 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28a5df7-1037-419b-a58d-acd76708bce9]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:40 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14 Feb 27 02:07:40 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:40 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14" returned: 0 in 0.729s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.79b5e59c-c2bd-43e2-8160-253a3bf1ba3e 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:40 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.79b5e59c-c2bd-43e2-8160-253a3bf1ba3e 1G Feb 27 02:07:40 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:41 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.79b5e59c-c2bd-43e2-8160-253a3bf1ba3e 1G" returned: 0 in 0.618s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.79b5e59c-c2bd-43e2-8160-253a3bf1ba3e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:41 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.79b5e59c-c2bd-43e2-8160-253a3bf1ba3e Feb 27 02:07:41 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:41 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.79b5e59c-c2bd-43e2-8160-253a3bf1ba3e" returned: 0 in 0.520s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:41 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.79b5e59c-c2bd-43e2-8160-253a3bf1ba3e is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:07:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.79b5e59c-c2bd-43e2-8160-253a3bf1ba3e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:41 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.79b5e59c-c2bd-43e2-8160-253a3bf1ba3e Feb 27 02:07:41 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:42 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.79b5e59c-c2bd-43e2-8160-253a3bf1ba3e" returned: 0 in 0.608s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:42 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.info Feb 27 02:07:42 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:43 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.info" returned: 0 in 0.501s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:43 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:07:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:43 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.info Feb 27 02:07:43 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:43 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.info" returned: 0 in 0.409s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.458s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.646s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-869685158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e03d5f5-3aca-4add-acd2-7b8d75526356,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='685e2444897d429193184e9f49490718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:34Z,use_quota=True,user_id='e9e12fd490fc489fa63cd0f9a7be422e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Creating volume 9e03d5f5-3aca-4add-acd2-7b8d75526356 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:43 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:07:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e03d5f5-3aca-4add-acd2-7b8d75526356 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:43 devstack sudo[88318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e03d5f5-3aca-4add-acd2-7b8d75526356 1073741824 Feb 27 02:07:43 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:43 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-5debd5d3-1ac0-4374-b427-52d6ba0684ab tempest-GroupSnapshotsTest-336945538 None] group_snapshot 3fcf0b23-7848-4b4a-aab2-403a9c1ac3d0: created successfully Feb 27 02:07:43 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] group_snapshot 3fcf0b23-7848-4b4a-aab2-403a9c1ac3d0: deleting Feb 27 02:07:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] group_snapshot 3fcf0b23-7848-4b4a-aab2-403a9c1ac3d0: deleting {{(pid=83167) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "cinder-quobyte-185df93c-202c-47c6-8a52-3b7288e4a4b3" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-185df93c-202c-47c6-8a52-3b7288e4a4b3" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "cinder-quobyte-3f1ed46c-100e-4de7-82c4-f77e43e50fc2" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-3f1ed46c-100e-4de7-82c4-f77e43e50fc2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Deleting offline snapshot 3f1ed46c-100e-4de7-82c4-f77e43e50fc2 of volume 185df93c-202c-47c6-8a52-3b7288e4a4b3 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] snapshot_file for this snap is: volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.3f1ed46c-100e-4de7-82c4-f77e43e50fc2 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2005f047-c829-4faf-8e53-89de93969f39]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.3f1ed46c-100e-4de7-82c4-f77e43e50fc2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:44 devstack sudo[88323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.3f1ed46c-100e-4de7-82c4-f77e43e50fc2 Feb 27 02:07:44 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:44 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e03d5f5-3aca-4add-acd2-7b8d75526356 1073741824" returned: 0 in 0.665s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e03d5f5-3aca-4add-acd2-7b8d75526356 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:44 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e03d5f5-3aca-4add-acd2-7b8d75526356 Feb 27 02:07:44 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:44 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e03d5f5-3aca-4add-acd2-7b8d75526356" returned: 0 in 0.480s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:44 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.809s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Acquiring lock "cinder-quobyte-9872097e-6cb5-4392-af5f-01a6fe2b5e13-0d34bf79-de57-41f7-a310-013f8f1bf960" by "_create_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.3f1ed46c-100e-4de7-82c4-f77e43e50fc2" returned: 0 in 0.631s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-185df93c-202c-47c6-8a52-3b7288e4a4b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979e59fe-0046-47c8-81a4-530765632176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e03d5f5-3aca-4add-acd2-7b8d75526356', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1fe55f-821e-46ac-95fb-5bdb7f7ee305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbf32ed-38bf-45e0-8b42-04ed8a61d41e]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Lock "cinder-quobyte-9872097e-6cb5-4392-af5f-01a6fe2b5e13-0d34bf79-de57-41f7-a310-013f8f1bf960" acquired by "_create_volume_from_snapshot" :: waited 0.060s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Creating volume 0d34bf79-de57-41f7-a310-013f8f1bf960 from snapshot 9872097e-6cb5-4392-af5f-01a6fe2b5e13 {{(pid=83167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Acquiring lock "cinder-quobyte-0d34bf79-de57-41f7-a310-013f8f1bf960" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:44 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Volume volume-9e03d5f5-3aca-4add-acd2-7b8d75526356 (9e03d5f5-3aca-4add-acd2-7b8d75526356): created successfully Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1fe55f-821e-46ac-95fb-5bdb7f7ee305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Flow 'volume_create_manager' (b1746979-aad5-470a-a46f-82cfe5bcc221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:44 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3a2548a4-2dcf-4e27-89c6-6e122bf498f5 tempest-VolumesListTestJSON-194557610 None] Created volume successfully. Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Lock "cinder-quobyte-0d34bf79-de57-41f7-a310-013f8f1bf960" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] snapshot: 9872097e-6cb5-4392-af5f-01a6fe2b5e13, volume: 0d34bf79-de57-41f7-a310-013f8f1bf960, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:44 devstack sudo[88331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3 Feb 27 02:07:44 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f383b9-c5c8-4986-8b3d-20bbb7120d88]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:44 devstack sudo[88333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13 Feb 27 02:07:44 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:45 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3" returned: 0 in 0.699s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.3f1ed46c-100e-4de7-82c4-f77e43e50fc2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:45 devstack sudo[88341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.3f1ed46c-100e-4de7-82c4-f77e43e50fc2 Feb 27 02:07:45 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:45 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13" returned: 0 in 0.681s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97f004aa-e114-4d80-84b6-87e939e23394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:07:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:07:45 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2c09fa-1f51-4f5b-9954-bf530f5a8daa]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:45 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 Feb 27 02:07:45 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Flow 'volume_create_manager' (48eb6477-ae69-45ee-bd7b-e4f3e4716b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84dca7e-6400-4294-ba69-661780918f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:46 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.3f1ed46c-100e-4de7-82c4-f77e43e50fc2" returned: 0 in 0.688s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.3f1ed46c-100e-4de7-82c4-f77e43e50fc2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84dca7e-6400-4294-ba69-661780918f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1851615986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203ca193-cb66-46b8-81bc-185af404537d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='685e2444897d429193184e9f49490718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:46Z,use_quota=True,user_id='e9e12fd490fc489fa63cd0f9a7be422e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a11fe99-3955-4924-a4f1-27c777329a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:46 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.3f1ed46c-100e-4de7-82c4-f77e43e50fc2 Feb 27 02:07:46 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a11fe99-3955-4924-a4f1-27c777329a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093b0b2b-b7ca-44d2-be1d-53d53742c49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093b0b2b-b7ca-44d2-be1d-53d53742c49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '203ca193-cb66-46b8-81bc-185af404537d', 'volume_name': 'volume-203ca193-cb66-46b8-81bc-185af404537d', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949fe407-c4a0-4713-8858-c26205b03f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949fe407-c4a0-4713-8858-c26205b03f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817c0aeb-fe8a-4c67-bd2f-5dfe87f6f8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:46 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Volume 203ca193-cb66-46b8-81bc-185af404537d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-203ca193-cb66-46b8-81bc-185af404537d', 'volume_size': 1} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:46 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394" returned: 0 in 0.803s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Path /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0d34bf79-de57-41f7-a310-013f8f1bf960 not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0d34bf79-de57-41f7-a310-013f8f1bf960 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:46 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0d34bf79-de57-41f7-a310-013f8f1bf960 Feb 27 02:07:46 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:46 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3.3f1ed46c-100e-4de7-82c4-f77e43e50fc2" returned: 0 in 0.597s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-3f1ed46c-100e-4de7-82c4-f77e43e50fc2" released by "_delete_snapshot" :: held 2.728s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-185df93c-202c-47c6-8a52-3b7288e4a4b3" released by "delete_snapshot" :: held 2.752s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "cinder-quobyte-7cdb0553-5fb5-492b-91bb-1c9deda5db14" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-7cdb0553-5fb5-492b-91bb-1c9deda5db14" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "cinder-quobyte-79b5e59c-c2bd-43e2-8160-253a3bf1ba3e" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-79b5e59c-c2bd-43e2-8160-253a3bf1ba3e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Deleting offline snapshot 79b5e59c-c2bd-43e2-8160-253a3bf1ba3e of volume 7cdb0553-5fb5-492b-91bb-1c9deda5db14 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] snapshot_file for this snap is: volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.79b5e59c-c2bd-43e2-8160-253a3bf1ba3e {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a20149-5b10-4620-84cd-1e11cde5ac4a]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.79b5e59c-c2bd-43e2-8160-253a3bf1ba3e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:46 devstack sudo[88356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.79b5e59c-c2bd-43e2-8160-253a3bf1ba3e Feb 27 02:07:46 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:47 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.79b5e59c-c2bd-43e2-8160-253a3bf1ba3e" returned: 0 in 0.972s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:47 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dd13ba-07aa-41e3-9294-4e1a398bb2c8]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:48 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14 Feb 27 02:07:48 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:49 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0d34bf79-de57-41f7-a310-013f8f1bf960" returned: 0 in 3.032s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:49 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d7aeb4-1402-484d-bca1-8904b22f1323]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:49 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 Feb 27 02:07:49 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:49 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14" returned: 0 in 1.659s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.79b5e59c-c2bd-43e2-8160-253a3bf1ba3e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:49 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.79b5e59c-c2bd-43e2-8160-253a3bf1ba3e Feb 27 02:07:49 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:50 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.79b5e59c-c2bd-43e2-8160-253a3bf1ba3e" returned: 0 in 0.719s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.79b5e59c-c2bd-43e2-8160-253a3bf1ba3e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:50 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.79b5e59c-c2bd-43e2-8160-253a3bf1ba3e Feb 27 02:07:50 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:50 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394" returned: 0 in 0.912s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:50 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Image conversion details: src /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394, size 1024.00 MB, duration 3.03 sec, destination /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0d34bf79-de57-41f7-a310-013f8f1bf960 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:07:50 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Converted 1024.00 MB image at 337.57 MB/s Feb 27 02:07:50 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0d34bf79-de57-41f7-a310-013f8f1bf960 is being set with open permissions: ugo+rw Feb 27 02:07:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0d34bf79-de57-41f7-a310-013f8f1bf960 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:50 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0d34bf79-de57-41f7-a310-013f8f1bf960 Feb 27 02:07:50 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:50 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14.79b5e59c-c2bd-43e2-8160-253a3bf1ba3e" returned: 0 in 0.531s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-79b5e59c-c2bd-43e2-8160-253a3bf1ba3e" released by "_delete_snapshot" :: held 3.990s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-7cdb0553-5fb5-492b-91bb-1c9deda5db14" released by "delete_snapshot" :: held 4.012s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:50 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0d34bf79-de57-41f7-a310-013f8f1bf960" returned: 0 in 0.524s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Lock "cinder-quobyte-0d34bf79-de57-41f7-a310-013f8f1bf960" released by "_copy_volume_from_snapshot" :: held 6.048s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Lock "cinder-quobyte-9872097e-6cb5-4392-af5f-01a6fe2b5e13-0d34bf79-de57-41f7-a310-013f8f1bf960" released by "_create_volume_from_snapshot" :: held 6.102s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.165s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 17.781s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:50 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Cloning volume 8d9049be-3b97-4417-bd90-1b83e4fe0575 to volume 1c117c35-0a89-4764-9c63-b62d99707350 Feb 27 02:07:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0a8b60-9d1e-44e1-8068-aee19452df23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d34bf79-de57-41f7-a310-013f8f1bf960', 'volume_size': 1, 'snapshot_id': '9872097e-6cb5-4392-af5f-01a6fe2b5e13'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c464908-2b80-4fdf-badd-62b33343871c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Creating offline snapshot 75c8fbe3-77da-4404-986e-98d964ca365a of volume 8d9049be-3b97-4417-bd90-1b83e4fe0575 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:50 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Volume volume-0d34bf79-de57-41f7-a310-013f8f1bf960 (0d34bf79-de57-41f7-a310-013f8f1bf960): created successfully Feb 27 02:07:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c464908-2b80-4fdf-badd-62b33343871c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Flow 'volume_create_manager' (e9416b19-e69b-4351-b8b2-2c8955f5cb8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:50 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1859fcfa-60ce-4628-8fb6-202ca03fcd43]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:50 devstack cinder-volume[83167]: WARNING cinder.quota [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-782778379 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-782778379, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:07:50 devstack cinder-volume[83167]: WARNING cinder.quota [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-782778379 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-782778379, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:07:51 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-254aaeb4-cb05-4045-8246-0832bffe3baf tempest-VolumeDependencyTests-60775104 None] Created volume successfully. Feb 27 02:07:51 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Created reservations ['ff7cf5a5-b921-4bba-84d4-589792ebdee7', '11c7aeac-c89f-48ef-a04d-52e5270b1c42', 'd25933e8-0692-4c44-9a52-25b5cafd15f4', 'c21b342a-b8f6-44f0-b066-b3250f332b77'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:51 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 Feb 27 02:07:51 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:51 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=137,cinder:INSERT=32,cinder:UPDATE=126,cinder:DELETE=10 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:07:51 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:INSERT=24,cinder:UPDATE=127,cinder:SELECT=99,cinder:DELETE=8 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:07:51 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] Created reservations ['6f2a6874-cf39-4817-98c6-6680ee346726', '9379f0ea-217d-4e15-8ba2-2ffa6c10830d', 'b1a2b13e-6582-46a8-adec-4c09715d1807', '838b5334-a923-4d66-b314-651270044b16'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:51 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-acb53152-d184-4ac1-bb18-ca6ae9f81c0c tempest-GroupSnapshotsTest-336945538 None] group_snapshot 3fcf0b23-7848-4b4a-aab2-403a9c1ac3d0: deleted successfully Feb 27 02:07:51 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575" returned: 0 in 0.637s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:51 devstack sudo[88398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a 1G Feb 27 02:07:51 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "cinder-quobyte-185df93c-202c-47c6-8a52-3b7288e4a4b3" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-185df93c-202c-47c6-8a52-3b7288e4a4b3" acquired by "delete_volume" :: waited 0.019s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b389bf-cb79-4fa5-ad5f-524d2ec7b6fa]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] Acquiring lock "cinder-9872097e-6cb5-4392-af5f-01a6fe2b5e13-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] Lock "cinder-9872097e-6cb5-4392-af5f-01a6fe2b5e13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] Acquiring lock "cinder-quobyte-97f004aa-e114-4d80-84b6-87e939e23394" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] Lock "cinder-quobyte-97f004aa-e114-4d80-84b6-87e939e23394" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] Acquiring lock "cinder-quobyte-9872097e-6cb5-4392-af5f-01a6fe2b5e13" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] Lock "cinder-quobyte-9872097e-6cb5-4392-af5f-01a6fe2b5e13" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] Deleting offline snapshot 9872097e-6cb5-4392-af5f-01a6fe2b5e13 of volume 97f004aa-e114-4d80-84b6-87e939e23394 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] snapshot_file for this snap is: volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2c7343-e06e-4f8f-b6ff-87f00adaaaf7]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:52 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3 Feb 27 02:07:52 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:52 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a 1G" returned: 0 in 0.624s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:52 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a Feb 27 02:07:52 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:52 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13 Feb 27 02:07:52 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:52 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3" returned: 0 in 0.696s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:52 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3 Feb 27 02:07:52 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:52 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13" returned: 0 in 0.685s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97f004aa-e114-4d80-84b6-87e939e23394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:52 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a" returned: 0 in 0.648s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:52 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a is being set with open permissions: ugo+rw Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d11991-d98f-48fe-a1b9-0adeddcf3210]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:52 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a Feb 27 02:07:52 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:53 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 Feb 27 02:07:53 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:53 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:53 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-185df93c-202c-47c6-8a52-3b7288e4a4b3" returned: 0 in 0.552s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a" returned: 0 in 0.455s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-185df93c-202c-47c6-8a52-3b7288e4a4b3" released by "delete_volume" :: held 1.302s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "cinder-quobyte-7cdb0553-5fb5-492b-91bb-1c9deda5db14" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-7cdb0553-5fb5-492b-91bb-1c9deda5db14" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:53 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb028e78-f3c5-4d77-9715-cfe110971876]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:53 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.info Feb 27 02:07:53 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:53 devstack sudo[88427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14 Feb 27 02:07:53 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:53 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394" returned: 0 in 0.699s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:53 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13 Feb 27 02:07:53 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:54 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14" returned: 0 in 0.629s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:54 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.info" returned: 0 in 0.683s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:54 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.info is being set with open permissions: ugo+rw Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:54 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14 Feb 27 02:07:54 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:54 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.info Feb 27 02:07:54 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:54 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13" returned: 0 in 0.544s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:54 devstack sudo[88446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13 Feb 27 02:07:54 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:54 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.info" returned: 0 in 0.590s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:54 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Acquiring lock "cinder-quobyte-1c117c35-0a89-4764-9c63-b62d99707350" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-7cdb0553-5fb5-492b-91bb-1c9deda5db14" returned: 0 in 0.653s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-7cdb0553-5fb5-492b-91bb-1c9deda5db14" released by "delete_volume" :: held 1.333s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Lock "cinder-quobyte-1c117c35-0a89-4764-9c63-b62d99707350" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] snapshot: 75c8fbe3-77da-4404-986e-98d964ca365a, volume: 1c117c35-0a89-4764-9c63-b62d99707350, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddb5807-8b33-4657-bfc6-f10bc4f4d03c]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:54 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394.9872097e-6cb5-4392-af5f-01a6fe2b5e13" returned: 0 in 0.626s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] Lock "cinder-quobyte-9872097e-6cb5-4392-af5f-01a6fe2b5e13" released by "_delete_snapshot" :: held 2.636s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] Lock "cinder-quobyte-97f004aa-e114-4d80-84b6-87e939e23394" released by "delete_snapshot" :: held 2.658s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:54 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a Feb 27 02:07:54 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Created reservations ['7f8158b2-14e8-4ac3-8bfe-2dc9b25bb963'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] Created reservations ['8843835d-dd77-4911-ad32-478f1fccb35d', '9ace57fe-a18b-44c5-b2e8-549144f788f1', '8c6b1d44-e5b5-4885-b11d-a58b90893540', 'd9c108e1-93e4-494c-ab9b-8de70b91de8e'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:54 devstack cinder-volume[83167]: WARNING cinder.quota [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-782778379 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-782778379, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:07:54 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Created reservations ['e3eef5e2-0521-4eee-a13c-b80c30fb06e5', '1ef261fd-9c5c-4933-970a-25464dfe62a5', '29f798a1-3f88-41d3-9cd5-3079e82803ae', '580c28fd-13a2-4afd-9826-37104b79496c'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:54 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] Delete snapshot completed successfully. Feb 27 02:07:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2bf77731-901c-47e4-9b2d-caaffdede48a tempest-VolumeDependencyTests-60775104 None] Lock "cinder-9872097e-6cb5-4392-af5f-01a6fe2b5e13-delete_snapshot" released by "delete_snapshot" :: held 2.882s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:55 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Created reservations ['385348a8-e93e-4b69-81f9-2bffb7c23d99', 'a8d73c18-b4cc-488e-8647-28a708907d6c', '2bb0c80d-223c-49cc-8d80-a49dfdaee746', 'f3e460c5-20b0-4b85-ad98-bc53e3fd397c'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:55 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:07:55 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6d0351c5-5db2-4b8a-8864-3d8b31047204 tempest-VolumeDependencyTests-60775104 None] Acquiring lock "cinder-97f004aa-e114-4d80-84b6-87e939e23394-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6d0351c5-5db2-4b8a-8864-3d8b31047204 tempest-VolumeDependencyTests-60775104 None] Lock "cinder-97f004aa-e114-4d80-84b6-87e939e23394-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6d0351c5-5db2-4b8a-8864-3d8b31047204 tempest-VolumeDependencyTests-60775104 None] Acquiring lock "cinder-quobyte-97f004aa-e114-4d80-84b6-87e939e23394" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6d0351c5-5db2-4b8a-8864-3d8b31047204 tempest-VolumeDependencyTests-60775104 None] Lock "cinder-quobyte-97f004aa-e114-4d80-84b6-87e939e23394" acquired by "delete_volume" :: waited 0.019s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:55 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4fbd70-4dfe-41c9-b416-1f4c5d3d4b2a]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6d0351c5-5db2-4b8a-8864-3d8b31047204 tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:55 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a" returned: 0 in 0.906s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d9049be-3b97-4417-bd90-1b83e4fe0575(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:07:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:07:55 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a02fa6-b447-41ad-aeee-3d22bae193ca]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:55 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 Feb 27 02:07:55 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:55 devstack sudo[88460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 Feb 27 02:07:55 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:55 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8a53e10e-6389-4cc9-bcc1-c24d880f8547 tempest-GroupSnapshotsTest-336945538 None] Group tempest-GroupSnapshotsTest-Group-1395029245: creating Feb 27 02:07:55 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8a53e10e-6389-4cc9-bcc1-c24d880f8547 tempest-GroupSnapshotsTest-336945538 None] Group tempest-GroupSnapshotsTest-Group-1395029245: created successfully Feb 27 02:07:55 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8a53e10e-6389-4cc9-bcc1-c24d880f8547 tempest-GroupSnapshotsTest-336945538 None] Create group completed successfully. Feb 27 02:07:56 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.825s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:56 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:56 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-95a3bc5b-87df-4cec-8523-6c9e5a87f71e tempest-GroupSnapshotsTest-336945538 None] Delete group completed successfully. Feb 27 02:07:56 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6d0351c5-5db2-4b8a-8864-3d8b31047204 tempest-VolumeDependencyTests-60775104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394" returned: 0 in 0.710s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6d0351c5-5db2-4b8a-8864-3d8b31047204 tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:56 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394 Feb 27 02:07:56 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:56 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575" returned: 0 in 0.769s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:56 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Path /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1c117c35-0a89-4764-9c63-b62d99707350 not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:07:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1c117c35-0a89-4764-9c63-b62d99707350 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:56 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1c117c35-0a89-4764-9c63-b62d99707350 Feb 27 02:07:56 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:56 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6d0351c5-5db2-4b8a-8864-3d8b31047204 tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97f004aa-e114-4d80-84b6-87e939e23394" returned: 0 in 0.598s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6d0351c5-5db2-4b8a-8864-3d8b31047204 tempest-VolumeDependencyTests-60775104 None] Lock "cinder-quobyte-97f004aa-e114-4d80-84b6-87e939e23394" released by "delete_volume" :: held 1.373s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:56 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-6d0351c5-5db2-4b8a-8864-3d8b31047204 tempest-VolumeDependencyTests-60775104 None] Created reservations ['60ca4e01-627e-404f-955b-98d198f5f4ed', '5c0c1647-e860-460d-82d2-579aa4cb7c74', '4de2e58f-0d1b-426f-84f2-3f57f0a76e92', '9cebd72c-49bb-405f-84ed-fc11e4ed72a7'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6d0351c5-5db2-4b8a-8864-3d8b31047204 tempest-VolumeDependencyTests-60775104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6d0351c5-5db2-4b8a-8864-3d8b31047204 tempest-VolumeDependencyTests-60775104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6d0351c5-5db2-4b8a-8864-3d8b31047204 tempest-VolumeDependencyTests-60775104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6d0351c5-5db2-4b8a-8864-3d8b31047204 tempest-VolumeDependencyTests-60775104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6d0351c5-5db2-4b8a-8864-3d8b31047204 tempest-VolumeDependencyTests-60775104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6d0351c5-5db2-4b8a-8864-3d8b31047204 tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:57 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:07:57 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:58 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Flow 'volume_create_manager' (7f507836-f6ae-491d-bf7a-c290aa267007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88dc9557-8e37-4035-9bd3-1187a80942ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88dc9557-8e37-4035-9bd3-1187a80942ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1950144421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=75852afc-2ac3-4082-93b0-9c2448ee76d8,host='devstack@QuobyteHD#QuobyteHD',id=ba650aab-223b-4d5c-94d1-d7ad720e53e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26950d6c2dfd42fcacafe8f91bb26640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:58Z,use_quota=True,user_id='83a17d618ee644b485716877ed52abfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8396009d-52af-4936-a99e-3f27440a899d),volume_type_id=8396009d-52af-4936-a99e-3f27440a899d)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5157a4-a50d-4e93-99a6-4bf7acba5b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5157a4-a50d-4e93-99a6-4bf7acba5b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abf171d-f1fb-44a9-9b93-92ac3d32c877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abf171d-f1fb-44a9-9b93-92ac3d32c877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba650aab-223b-4d5c-94d1-d7ad720e53e8', 'volume_name': 'volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123f3a6b-1aa3-4390-9cbb-b2523f1761b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123f3a6b-1aa3-4390-9cbb-b2523f1761b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a78a1cb-dbaf-4dd2-9420-b94bb0a136bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:58 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Volume ba650aab-223b-4d5c-94d1-d7ad720e53e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8', 'volume_size': 1} Feb 27 02:07:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:59 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6d0351c5-5db2-4b8a-8864-3d8b31047204 tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 2.351s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:59 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-6d0351c5-5db2-4b8a-8864-3d8b31047204 tempest-VolumeDependencyTests-60775104 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:59 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-6d0351c5-5db2-4b8a-8864-3d8b31047204 tempest-VolumeDependencyTests-60775104 None] Deleted volume successfully. Feb 27 02:07:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-6d0351c5-5db2-4b8a-8864-3d8b31047204 tempest-VolumeDependencyTests-60775104 None] Lock "cinder-97f004aa-e114-4d80-84b6-87e939e23394-delete_volume" released by "delete_volume" :: held 3.987s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:59 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Flow 'volume_create_manager' (f28d2ae8-d0bf-4040-811c-200efbcc0a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3b1dd2-52da-4889-8cf3-3510a00e223f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:59 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3b1dd2-52da-4889-8cf3-3510a00e223f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-115106991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a145f91c-c34b-45a6-ae0b-e2550fb3c459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5964b08eade44fad9095b88e59a10707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:00Z,use_quota=True,user_id='b09a13fd35964a908b7af8c41962b5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8079492e-d400-41b9-90e7-b2ec4a305538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8079492e-d400-41b9-90e7-b2ec4a305538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b11077-3a31-454f-bc8a-9bde154ef376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b11077-3a31-454f-bc8a-9bde154ef376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a145f91c-c34b-45a6-ae0b-e2550fb3c459', 'volume_name': 'volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb2193d-32e1-4a67-9493-c00fd62aaa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb2193d-32e1-4a67-9493-c00fd62aaa99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14becda1-0f29-499b-891b-6096b9af93fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:59 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Volume a145f91c-c34b-45a6-ae0b-e2550fb3c459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459', 'volume_size': 1} Feb 27 02:07:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1c117c35-0a89-4764-9c63-b62d99707350" returned: 0 in 3.192s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:59 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a95c03-efab-48a1-9cfa-e5fe2a17b1ce]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:59 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 Feb 27 02:07:59 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:00 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575" returned: 0 in 0.675s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:00 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Image conversion details: src /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575, size 1024.00 MB, duration 3.19 sec, destination /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1c117c35-0a89-4764-9c63-b62d99707350 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:08:00 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Converted 1024.00 MB image at 320.71 MB/s Feb 27 02:08:00 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1c117c35-0a89-4764-9c63-b62d99707350 is being set with open permissions: ugo+rw Feb 27 02:08:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1c117c35-0a89-4764-9c63-b62d99707350 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:00 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1c117c35-0a89-4764-9c63-b62d99707350 Feb 27 02:08:00 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:00 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1c117c35-0a89-4764-9c63-b62d99707350" returned: 0 in 0.511s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Lock "cinder-quobyte-1c117c35-0a89-4764-9c63-b62d99707350" released by "_copy_volume_from_snapshot" :: held 6.123s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Acquiring lock "cinder-quobyte-75c8fbe3-77da-4404-986e-98d964ca365a" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Lock "cinder-quobyte-75c8fbe3-77da-4404-986e-98d964ca365a" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:00 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Deleting offline snapshot 75c8fbe3-77da-4404-986e-98d964ca365a of volume 8d9049be-3b97-4417-bd90-1b83e4fe0575 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:08:00 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] snapshot_file for this snap is: volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:08:00 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8852f9-63c4-4e75-83bb-688323ac693d]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:00 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a Feb 27 02:08:00 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:01 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a" returned: 0 in 0.573s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d9049be-3b97-4417-bd90-1b83e4fe0575(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:01 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c23e9d2-e46e-4b2e-aa14-678508ae388f]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:01 devstack sudo[88502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 Feb 27 02:08:01 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:02 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575" returned: 0 in 0.652s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:02 devstack sudo[88507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a Feb 27 02:08:02 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:02 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a" returned: 0 in 0.656s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:02 devstack sudo[88512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a Feb 27 02:08:02 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:03 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575.75c8fbe3-77da-4404-986e-98d964ca365a" returned: 0 in 0.511s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Lock "cinder-quobyte-75c8fbe3-77da-4404-986e-98d964ca365a" released by "_delete_snapshot" :: held 2.462s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.470s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.149s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1851615986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203ca193-cb66-46b8-81bc-185af404537d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='685e2444897d429193184e9f49490718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:46Z,use_quota=True,user_id='e9e12fd490fc489fa63cd0f9a7be422e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Creating volume 203ca193-cb66-46b8-81bc-185af404537d {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:03 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:08:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-203ca193-cb66-46b8-81bc-185af404537d 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca529069-d0c9-46db-a5b3-1384539b0f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c117c35-0a89-4764-9c63-b62d99707350', 'volume_size': 2, 'source_volid': '8d9049be-3b97-4417-bd90-1b83e4fe0575', 'source_volstatus': 'available'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3672c76d-0387-426a-9466-a9859a82503e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:03 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-203ca193-cb66-46b8-81bc-185af404537d 1073741824 Feb 27 02:08:03 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:03 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Volume volume-1c117c35-0a89-4764-9c63-b62d99707350 (1c117c35-0a89-4764-9c63-b62d99707350): created successfully Feb 27 02:08:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3672c76d-0387-426a-9466-a9859a82503e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Flow 'volume_create_manager' (c96e8c83-ea72-4ca8-aeff-206485c46f79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:03 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e3fb5056-51b6-4c80-b1b1-8b0181059cf1 tempest-VolumesCloneTest-1568589259 None] Created volume successfully. Feb 27 02:08:04 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-203ca193-cb66-46b8-81bc-185af404537d 1073741824" returned: 0 in 0.721s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-203ca193-cb66-46b8-81bc-185af404537d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:04 devstack sudo[88520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-203ca193-cb66-46b8-81bc-185af404537d Feb 27 02:08:04 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:04 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-203ca193-cb66-46b8-81bc-185af404537d" returned: 0 in 0.536s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.278s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=75852afc-2ac3-4082-93b0-9c2448ee76d8,created_at=2026-02-27T01:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1950144421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=75852afc-2ac3-4082-93b0-9c2448ee76d8,host='devstack@QuobyteHD#QuobyteHD',id=ba650aab-223b-4d5c-94d1-d7ad720e53e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26950d6c2dfd42fcacafe8f91bb26640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:58Z,use_quota=True,user_id='83a17d618ee644b485716877ed52abfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8396009d-52af-4936-a99e-3f27440a899d),volume_type_id=8396009d-52af-4936-a99e-3f27440a899d)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Creating volume ba650aab-223b-4d5c-94d1-d7ad720e53e8 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:04 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b8045c21-fea7-4a53-8deb-7713b3d69d1d tempest-VolumesCloneTest-1568589259 None] Acquiring lock "cinder-1c117c35-0a89-4764-9c63-b62d99707350-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:04 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8 1073741824 Feb 27 02:08:04 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817c0aeb-fe8a-4c67-bd2f-5dfe87f6f8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-203ca193-cb66-46b8-81bc-185af404537d', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1ed629-7956-43b4-b45b-b78cbe6ad2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:04 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Volume volume-203ca193-cb66-46b8-81bc-185af404537d (203ca193-cb66-46b8-81bc-185af404537d): created successfully Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1ed629-7956-43b4-b45b-b78cbe6ad2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Flow 'volume_create_manager' (48eb6477-ae69-45ee-bd7b-e4f3e4716b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b8045c21-fea7-4a53-8deb-7713b3d69d1d tempest-VolumesCloneTest-1568589259 None] Lock "cinder-1c117c35-0a89-4764-9c63-b62d99707350-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:04 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1ff35d15-8999-46ad-93c3-be20d125d96a tempest-VolumesListTestJSON-194557610 None] Created volume successfully. Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b8045c21-fea7-4a53-8deb-7713b3d69d1d tempest-VolumesCloneTest-1568589259 None] Acquiring lock "cinder-quobyte-1c117c35-0a89-4764-9c63-b62d99707350" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b8045c21-fea7-4a53-8deb-7713b3d69d1d tempest-VolumesCloneTest-1568589259 None] Lock "cinder-quobyte-1c117c35-0a89-4764-9c63-b62d99707350" acquired by "delete_volume" :: waited 0.018s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf91b198-ae07-4505-b0a0-551f0ec3e20e]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b8045c21-fea7-4a53-8deb-7713b3d69d1d tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1c117c35-0a89-4764-9c63-b62d99707350 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:04 devstack sudo[88525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1c117c35-0a89-4764-9c63-b62d99707350 Feb 27 02:08:04 devstack sudo[88525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:05 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8 1073741824" returned: 0 in 0.746s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:05 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8 Feb 27 02:08:05 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:05 devstack sudo[88525]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b8045c21-fea7-4a53-8deb-7713b3d69d1d tempest-VolumesCloneTest-1568589259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1c117c35-0a89-4764-9c63-b62d99707350" returned: 0 in 0.769s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b8045c21-fea7-4a53-8deb-7713b3d69d1d tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1c117c35-0a89-4764-9c63-b62d99707350 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:05 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1c117c35-0a89-4764-9c63-b62d99707350 Feb 27 02:08:05 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:06 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8" returned: 0 in 0.551s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.417s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-115106991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a145f91c-c34b-45a6-ae0b-e2550fb3c459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5964b08eade44fad9095b88e59a10707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:00Z,use_quota=True,user_id='b09a13fd35964a908b7af8c41962b5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Creating volume a145f91c-c34b-45a6-ae0b-e2550fb3c459 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:06 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a78a1cb-dbaf-4dd2-9420-b94bb0a136bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc33c21-6f53-4bbd-ac84-1fbe072e62e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:06 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 1073741824 Feb 27 02:08:06 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:06 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Volume volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8 (ba650aab-223b-4d5c-94d1-d7ad720e53e8): created successfully Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc33c21-6f53-4bbd-ac84-1fbe072e62e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Flow 'volume_create_manager' (7f507836-f6ae-491d-bf7a-c290aa267007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:06 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8c47bb86-0de8-4485-ba2b-736092b6d536 tempest-GroupSnapshotsTest-336945538 None] Created volume successfully. Feb 27 02:08:06 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b8045c21-fea7-4a53-8deb-7713b3d69d1d tempest-VolumesCloneTest-1568589259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1c117c35-0a89-4764-9c63-b62d99707350" returned: 0 in 0.667s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b8045c21-fea7-4a53-8deb-7713b3d69d1d tempest-VolumesCloneTest-1568589259 None] Lock "cinder-quobyte-1c117c35-0a89-4764-9c63-b62d99707350" released by "delete_volume" :: held 1.465s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-b8045c21-fea7-4a53-8deb-7713b3d69d1d tempest-VolumesCloneTest-1568589259 None] Created reservations ['f9f0e917-7bd2-400b-b2d5-0956412a8828', '766eb005-a6e3-421c-99e6-a331013034c9', 'f69ef1fe-d62a-4481-9746-c191d6e9cfa7', '94c90045-82ed-4c30-a97a-9be354fb9305'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b8045c21-fea7-4a53-8deb-7713b3d69d1d tempest-VolumesCloneTest-1568589259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b8045c21-fea7-4a53-8deb-7713b3d69d1d tempest-VolumesCloneTest-1568589259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b8045c21-fea7-4a53-8deb-7713b3d69d1d tempest-VolumesCloneTest-1568589259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b8045c21-fea7-4a53-8deb-7713b3d69d1d tempest-VolumesCloneTest-1568589259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b8045c21-fea7-4a53-8deb-7713b3d69d1d tempest-VolumesCloneTest-1568589259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b8045c21-fea7-4a53-8deb-7713b3d69d1d tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:06 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:08:06 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:06 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 1073741824" returned: 0 in 0.918s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:07 devstack sudo[88547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 Feb 27 02:08:07 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:07 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b8045c21-fea7-4a53-8deb-7713b3d69d1d tempest-VolumesCloneTest-1568589259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.612s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-b8045c21-fea7-4a53-8deb-7713b3d69d1d tempest-VolumesCloneTest-1568589259 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:07 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b8045c21-fea7-4a53-8deb-7713b3d69d1d tempest-VolumesCloneTest-1568589259 None] Deleted volume successfully. Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b8045c21-fea7-4a53-8deb-7713b3d69d1d tempest-VolumesCloneTest-1568589259 None] Lock "cinder-1c117c35-0a89-4764-9c63-b62d99707350-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1796034c-a955-4fea-90ca-e155d984bdd8 tempest-VolumesCloneTest-1568589259 None] Acquiring lock "cinder-8d9049be-3b97-4417-bd90-1b83e4fe0575-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1796034c-a955-4fea-90ca-e155d984bdd8 tempest-VolumesCloneTest-1568589259 None] Lock "cinder-8d9049be-3b97-4417-bd90-1b83e4fe0575-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1796034c-a955-4fea-90ca-e155d984bdd8 tempest-VolumesCloneTest-1568589259 None] Acquiring lock "cinder-quobyte-8d9049be-3b97-4417-bd90-1b83e4fe0575" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1796034c-a955-4fea-90ca-e155d984bdd8 tempest-VolumesCloneTest-1568589259 None] Lock "cinder-quobyte-8d9049be-3b97-4417-bd90-1b83e4fe0575" acquired by "delete_volume" :: waited 0.023s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceaf394d-2998-4375-943a-09ac35704528]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1796034c-a955-4fea-90ca-e155d984bdd8 tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:07 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 Feb 27 02:08:07 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:07 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] GroupSnapshot 059ac25d-63cd-41e9-b1a1-94a75b3594f4: creating. Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] Group snapshot 059ac25d-63cd-41e9-b1a1-94a75b3594f4: creating. {{(pid=83167) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5845f4cb-2b74-462d-bca8-1df67c2402bb tempest-VolumesListTestJSON-194557610 None] Acquiring lock "cinder-203ca193-cb66-46b8-81bc-185af404537d-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5845f4cb-2b74-462d-bca8-1df67c2402bb tempest-VolumesListTestJSON-194557610 None] Lock "cinder-203ca193-cb66-46b8-81bc-185af404537d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5845f4cb-2b74-462d-bca8-1df67c2402bb tempest-VolumesListTestJSON-194557610 None] Acquiring lock "cinder-quobyte-203ca193-cb66-46b8-81bc-185af404537d" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5845f4cb-2b74-462d-bca8-1df67c2402bb tempest-VolumesListTestJSON-194557610 None] Lock "cinder-quobyte-203ca193-cb66-46b8-81bc-185af404537d" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:07 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459" returned: 0 in 0.719s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4994949-c3de-4246-b58a-e086e56d269c]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.155s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5845f4cb-2b74-462d-bca8-1df67c2402bb tempest-VolumesListTestJSON-194557610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-203ca193-cb66-46b8-81bc-185af404537d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14becda1-0f29-499b-891b-6096b9af93fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14b4a5b1-6b4c-4a1a-aac8-b80351627b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] Creating offline snapshot 20173761-e637-4a9c-9d4c-f6f9c613cd3d of volume ba650aab-223b-4d5c-94d1-d7ad720e53e8 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:07 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Volume volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 (a145f91c-c34b-45a6-ae0b-e2550fb3c459): created successfully Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14b4a5b1-6b4c-4a1a-aac8-b80351627b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Flow 'volume_create_manager' (f28d2ae8-d0bf-4040-811c-200efbcc0a5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6a3385-810d-4e61-ade2-5048faead07d]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:07 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8f0c8b0e-2192-40c1-b13d-ebccfa6c248b tempest-VolumeDependencyTests-60775104 None] Created volume successfully. Feb 27 02:08:07 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-203ca193-cb66-46b8-81bc-185af404537d Feb 27 02:08:07 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:07 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8 Feb 27 02:08:07 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:07 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1796034c-a955-4fea-90ca-e155d984bdd8 tempest-VolumesCloneTest-1568589259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575" returned: 0 in 0.780s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1796034c-a955-4fea-90ca-e155d984bdd8 tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:08 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575 Feb 27 02:08:08 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:08 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5845f4cb-2b74-462d-bca8-1df67c2402bb tempest-VolumesListTestJSON-194557610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-203ca193-cb66-46b8-81bc-185af404537d" returned: 0 in 0.684s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5845f4cb-2b74-462d-bca8-1df67c2402bb tempest-VolumesListTestJSON-194557610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-203ca193-cb66-46b8-81bc-185af404537d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:08 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8" returned: 0 in 0.657s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.20173761-e637-4a9c-9d4c-f6f9c613cd3d 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:08 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-203ca193-cb66-46b8-81bc-185af404537d Feb 27 02:08:08 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:08 devstack sudo[88569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.20173761-e637-4a9c-9d4c-f6f9c613cd3d 1G Feb 27 02:08:08 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:08 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1796034c-a955-4fea-90ca-e155d984bdd8 tempest-VolumesCloneTest-1568589259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8d9049be-3b97-4417-bd90-1b83e4fe0575" returned: 0 in 0.701s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1796034c-a955-4fea-90ca-e155d984bdd8 tempest-VolumesCloneTest-1568589259 None] Lock "cinder-quobyte-8d9049be-3b97-4417-bd90-1b83e4fe0575" released by "delete_volume" :: held 1.537s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Flow 'volume_create_manager' (9b562473-458b-4798-a34b-1026f6754ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a58cc3-2e95-4e04-8188-577298361f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a58cc3-2e95-4e04-8188-577298361f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-532321557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d81d884-1568-4bf0-bd4a-d95a438ec45d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5964b08eade44fad9095b88e59a10707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a145f91c-c34b-45a6-ae0b-e2550fb3c459,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:09Z,use_quota=True,user_id='b09a13fd35964a908b7af8c41962b5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a31d5f6-b767-4fe6-901e-551e89b001e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a31d5f6-b767-4fe6-901e-551e89b001e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92aea043-0b96-448e-9177-a9cb08465a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92aea043-0b96-448e-9177-a9cb08465a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5d81d884-1568-4bf0-bd4a-d95a438ec45d', 'volume_name': 'volume-5d81d884-1568-4bf0-bd4a-d95a438ec45d', 'volume_size': 1, 'source_volid': 'a145f91c-c34b-45a6-ae0b-e2550fb3c459', 'source_volstatus': 'available'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde8f05a-99f1-4f74-b6f2-709fd3742f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde8f05a-99f1-4f74-b6f2-709fd3742f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c668d4-c64d-476a-834b-e5264bed90a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:08 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Volume 5d81d884-1568-4bf0-bd4a-d95a438ec45d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5d81d884-1568-4bf0-bd4a-d95a438ec45d', 'volume_size': 1, 'source_volid': 'a145f91c-c34b-45a6-ae0b-e2550fb3c459', 'source_volstatus': 'available'} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-1796034c-a955-4fea-90ca-e155d984bdd8 tempest-VolumesCloneTest-1568589259 None] Created reservations ['76b18af2-1aff-45ed-825b-4f960f3a4f10', '1b923627-c59e-4b0f-83cf-18a436f7f097', 'd7916510-7dc4-4409-b085-b249243fec05', '77cfc797-4cae-4a1d-8798-5d394e1b98be'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1796034c-a955-4fea-90ca-e155d984bdd8 tempest-VolumesCloneTest-1568589259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1796034c-a955-4fea-90ca-e155d984bdd8 tempest-VolumesCloneTest-1568589259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1796034c-a955-4fea-90ca-e155d984bdd8 tempest-VolumesCloneTest-1568589259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1796034c-a955-4fea-90ca-e155d984bdd8 tempest-VolumesCloneTest-1568589259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1796034c-a955-4fea-90ca-e155d984bdd8 tempest-VolumesCloneTest-1568589259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1796034c-a955-4fea-90ca-e155d984bdd8 tempest-VolumesCloneTest-1568589259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:08 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:08:08 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:09 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5845f4cb-2b74-462d-bca8-1df67c2402bb tempest-VolumesListTestJSON-194557610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-203ca193-cb66-46b8-81bc-185af404537d" returned: 0 in 0.692s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5845f4cb-2b74-462d-bca8-1df67c2402bb tempest-VolumesListTestJSON-194557610 None] Lock "cinder-quobyte-203ca193-cb66-46b8-81bc-185af404537d" released by "delete_volume" :: held 1.428s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:09 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.20173761-e637-4a9c-9d4c-f6f9c613cd3d 1G" returned: 0 in 0.720s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.20173761-e637-4a9c-9d4c-f6f9c613cd3d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-5845f4cb-2b74-462d-bca8-1df67c2402bb tempest-VolumesListTestJSON-194557610 None] Created reservations ['5965a0f0-cc6b-495d-8929-5bda32061172', '5fe8de60-5e4f-4202-8cd1-29b8eca424cb', '5e977b4d-747c-4984-9645-6329bea3010c', '4615ef71-85bf-4bd8-947d-5a11c06f9cfb'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:09 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.20173761-e637-4a9c-9d4c-f6f9c613cd3d Feb 27 02:08:09 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5845f4cb-2b74-462d-bca8-1df67c2402bb tempest-VolumesListTestJSON-194557610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5845f4cb-2b74-462d-bca8-1df67c2402bb tempest-VolumesListTestJSON-194557610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5845f4cb-2b74-462d-bca8-1df67c2402bb tempest-VolumesListTestJSON-194557610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5845f4cb-2b74-462d-bca8-1df67c2402bb tempest-VolumesListTestJSON-194557610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5845f4cb-2b74-462d-bca8-1df67c2402bb tempest-VolumesListTestJSON-194557610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5845f4cb-2b74-462d-bca8-1df67c2402bb tempest-VolumesListTestJSON-194557610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:09 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:08:09 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:09 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1796034c-a955-4fea-90ca-e155d984bdd8 tempest-VolumesCloneTest-1568589259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.637s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-1796034c-a955-4fea-90ca-e155d984bdd8 tempest-VolumesCloneTest-1568589259 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:09 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1796034c-a955-4fea-90ca-e155d984bdd8 tempest-VolumesCloneTest-1568589259 None] Deleted volume successfully. Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1796034c-a955-4fea-90ca-e155d984bdd8 tempest-VolumesCloneTest-1568589259 None] Lock "cinder-8d9049be-3b97-4417-bd90-1b83e4fe0575-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:09 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5845f4cb-2b74-462d-bca8-1df67c2402bb tempest-VolumesListTestJSON-194557610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.495s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-5845f4cb-2b74-462d-bca8-1df67c2402bb tempest-VolumesListTestJSON-194557610 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:09 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-5845f4cb-2b74-462d-bca8-1df67c2402bb tempest-VolumesListTestJSON-194557610 None] Deleted volume successfully. Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5845f4cb-2b74-462d-bca8-1df67c2402bb tempest-VolumesListTestJSON-194557610 None] Lock "cinder-203ca193-cb66-46b8-81bc-185af404537d-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:09 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.20173761-e637-4a9c-9d4c-f6f9c613cd3d" returned: 0 in 0.658s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:09 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.20173761-e637-4a9c-9d4c-f6f9c613cd3d is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.20173761-e637-4a9c-9d4c-f6f9c613cd3d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:09 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.20173761-e637-4a9c-9d4c-f6f9c613cd3d Feb 27 02:08:09 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d926b6af-dac3-461e-847f-b8f6cddfd5b8 tempest-VolumesListTestJSON-194557610 None] Acquiring lock "cinder-9e03d5f5-3aca-4add-acd2-7b8d75526356-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d926b6af-dac3-461e-847f-b8f6cddfd5b8 tempest-VolumesListTestJSON-194557610 None] Lock "cinder-9e03d5f5-3aca-4add-acd2-7b8d75526356-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d926b6af-dac3-461e-847f-b8f6cddfd5b8 tempest-VolumesListTestJSON-194557610 None] Acquiring lock "cinder-quobyte-9e03d5f5-3aca-4add-acd2-7b8d75526356" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d926b6af-dac3-461e-847f-b8f6cddfd5b8 tempest-VolumesListTestJSON-194557610 None] Lock "cinder-quobyte-9e03d5f5-3aca-4add-acd2-7b8d75526356" acquired by "delete_volume" :: waited 0.019s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:10 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f145ae06-e275-4492-a844-dd214127bc0f]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d926b6af-dac3-461e-847f-b8f6cddfd5b8 tempest-VolumesListTestJSON-194557610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e03d5f5-3aca-4add-acd2-7b8d75526356 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:10 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e03d5f5-3aca-4add-acd2-7b8d75526356 Feb 27 02:08:10 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:10 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.20173761-e637-4a9c-9d4c-f6f9c613cd3d" returned: 0 in 0.505s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:10 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.info Feb 27 02:08:10 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:10 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d926b6af-dac3-461e-847f-b8f6cddfd5b8 tempest-VolumesListTestJSON-194557610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e03d5f5-3aca-4add-acd2-7b8d75526356" returned: 0 in 0.652s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d926b6af-dac3-461e-847f-b8f6cddfd5b8 tempest-VolumesListTestJSON-194557610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e03d5f5-3aca-4add-acd2-7b8d75526356 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:10 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e03d5f5-3aca-4add-acd2-7b8d75526356 Feb 27 02:08:10 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:11 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.info" returned: 0 in 0.651s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:11 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:08:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:11 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.info Feb 27 02:08:11 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:11 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d926b6af-dac3-461e-847f-b8f6cddfd5b8 tempest-VolumesListTestJSON-194557610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9e03d5f5-3aca-4add-acd2-7b8d75526356" returned: 0 in 0.565s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d926b6af-dac3-461e-847f-b8f6cddfd5b8 tempest-VolumesListTestJSON-194557610 None] Lock "cinder-quobyte-9e03d5f5-3aca-4add-acd2-7b8d75526356" released by "delete_volume" :: held 1.251s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:11 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-d926b6af-dac3-461e-847f-b8f6cddfd5b8 tempest-VolumesListTestJSON-194557610 None] Created reservations ['a1dd7735-06af-4c69-9e70-bb56fd4490b3', '0d533ae7-1ebb-4b14-be78-6e58490fb619', '53d1276d-0b99-45a2-b079-36601a73521e', '6986026f-287a-4fb3-81ed-108f60701d3a'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d926b6af-dac3-461e-847f-b8f6cddfd5b8 tempest-VolumesListTestJSON-194557610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d926b6af-dac3-461e-847f-b8f6cddfd5b8 tempest-VolumesListTestJSON-194557610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d926b6af-dac3-461e-847f-b8f6cddfd5b8 tempest-VolumesListTestJSON-194557610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d926b6af-dac3-461e-847f-b8f6cddfd5b8 tempest-VolumesListTestJSON-194557610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d926b6af-dac3-461e-847f-b8f6cddfd5b8 tempest-VolumesListTestJSON-194557610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d926b6af-dac3-461e-847f-b8f6cddfd5b8 tempest-VolumesListTestJSON-194557610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:11 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:08:11 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:11 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.info" returned: 0 in 0.678s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.992s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.872s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:11 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Cloning volume a145f91c-c34b-45a6-ae0b-e2550fb3c459 to volume 5d81d884-1568-4bf0-bd4a-d95a438ec45d Feb 27 02:08:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Creating offline snapshot ade3ed68-9a64-489a-9864-d7fc23a2342f of volume a145f91c-c34b-45a6-ae0b-e2550fb3c459 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:11 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c839c07-c5dd-45e2-82ff-0167f267a96d]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:11 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-4f215d7f-e1fe-4f46-9423-dab8751e6c4b tempest-GroupSnapshotsTest-336945538 None] group_snapshot 059ac25d-63cd-41e9-b1a1-94a75b3594f4: created successfully Feb 27 02:08:11 devstack sudo[88607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 Feb 27 02:08:11 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:11 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Flow 'volume_create_manager' (b2824ba6-1dff-49fe-bb72-c5bca3a34967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f61bb70-a12f-4f71-8df8-b9ec445489cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f61bb70-a12f-4f71-8df8-b9ec445489cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1377500555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93f64229-8086-4c96-b77f-d8b121660f5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c3284d3b2bc4fc7974034a5d4392b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:12Z,use_quota=True,user_id='9b2c2733b2f342579613f078f638a9ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b83996-3020-4c53-8100-863006906749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b83996-3020-4c53-8100-863006906749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2699781-a22a-46b3-a178-87bbc144039b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG cinder.image.glance [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Creating Keystone auth plugin from conf {{(pid=83167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 02:08:12 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d926b6af-dac3-461e-847f-b8f6cddfd5b8 tempest-VolumesListTestJSON-194557610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.675s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-d926b6af-dac3-461e-847f-b8f6cddfd5b8 tempest-VolumesListTestJSON-194557610 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:12 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d926b6af-dac3-461e-847f-b8f6cddfd5b8 tempest-VolumesListTestJSON-194557610 None] Deleted volume successfully. Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d926b6af-dac3-461e-847f-b8f6cddfd5b8 tempest-VolumesListTestJSON-194557610 None] Lock "cinder-9e03d5f5-3aca-4add-acd2-7b8d75526356-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c3244111-4d58-461b-bfb4-d56b9c2134bd tempest-VolumesListTestJSON-194557610 None] Acquiring lock "cinder-0fe5b159-59f1-4a8f-97e1-517788dbb8b4-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c3244111-4d58-461b-bfb4-d56b9c2134bd tempest-VolumesListTestJSON-194557610 None] Lock "cinder-0fe5b159-59f1-4a8f-97e1-517788dbb8b4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2699781-a22a-46b3-a178-87bbc144039b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '93f64229-8086-4c96-b77f-d8b121660f5c', 'volume_name': 'volume-93f64229-8086-4c96-b77f-d8b121660f5c', 'volume_size': 1, 'image_id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c3ebea7eea44d62b013a3b663b3a45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74e16fab-69df-4cb3-99da-0b06bc338767/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31a270a-357e-4547-b374-b8affa34c43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31a270a-357e-4547-b374-b8affa34c43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9608fa6e-6c6e-4add-b4d7-39e1db5e68c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:12 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Volume 93f64229-8086-4c96-b77f-d8b121660f5c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-93f64229-8086-4c96-b77f-d8b121660f5c', 'volume_size': 1, 'image_id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c3ebea7eea44d62b013a3b663b3a45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74e16fab-69df-4cb3-99da-0b06bc338767/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Trying to clone 93f64229-8086-4c96-b77f-d8b121660f5c from image 74e16fab-69df-4cb3-99da-0b06bc338767 at location (None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}]). {{(pid=83167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c3244111-4d58-461b-bfb4-d56b9c2134bd tempest-VolumesListTestJSON-194557610 None] Acquiring lock "cinder-quobyte-0fe5b159-59f1-4a8f-97e1-517788dbb8b4" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c3244111-4d58-461b-bfb4-d56b9c2134bd tempest-VolumesListTestJSON-194557610 None] Lock "cinder-quobyte-0fe5b159-59f1-4a8f-97e1-517788dbb8b4" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[509d3ea3-c58c-4801-8735-482eda110221]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c3244111-4d58-461b-bfb4-d56b9c2134bd tempest-VolumesListTestJSON-194557610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0fe5b159-59f1-4a8f-97e1-517788dbb8b4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:12 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0fe5b159-59f1-4a8f-97e1-517788dbb8b4 Feb 27 02:08:12 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_b11j9z3pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 02:08:12 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Image download 20.69 MB at 20.69 MB/s Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5934fa8d-d513-4607-82e0-f9df80041b8e]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_b11j9z3pdevstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:12 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459" returned: 0 in 0.800s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:12 devstack sudo[88617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f 1G Feb 27 02:08:12 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:12 devstack sudo[88616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_b11j9z3pdevstack@QuobyteHD Feb 27 02:08:12 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:13 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] group_snapshot 059ac25d-63cd-41e9-b1a1-94a75b3594f4: deleting Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] group_snapshot 059ac25d-63cd-41e9-b1a1-94a75b3594f4: deleting {{(pid=83167) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "cinder-quobyte-ba650aab-223b-4d5c-94d1-d7ad720e53e8" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:13 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-ba650aab-223b-4d5c-94d1-d7ad720e53e8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "cinder-quobyte-20173761-e637-4a9c-9d4c-f6f9c613cd3d" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c3244111-4d58-461b-bfb4-d56b9c2134bd tempest-VolumesListTestJSON-194557610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0fe5b159-59f1-4a8f-97e1-517788dbb8b4" returned: 0 in 0.809s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c3244111-4d58-461b-bfb4-d56b9c2134bd tempest-VolumesListTestJSON-194557610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0fe5b159-59f1-4a8f-97e1-517788dbb8b4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-20173761-e637-4a9c-9d4c-f6f9c613cd3d" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] Deleting offline snapshot 20173761-e637-4a9c-9d4c-f6f9c613cd3d of volume ba650aab-223b-4d5c-94d1-d7ad720e53e8 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:08:13 devstack sudo[88629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0fe5b159-59f1-4a8f-97e1-517788dbb8b4 Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] snapshot_file for this snap is: volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.20173761-e637-4a9c-9d4c-f6f9c613cd3d {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:08:13 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2541d382-eaa3-445e-934c-e905f7252b80]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.20173761-e637-4a9c-9d4c-f6f9c613cd3d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:13 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_b11j9z3pdevstack@QuobyteHD" returned: 0 in 0.658s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Temporary image 74e16fab-69df-4cb3-99da-0b06bc338767 is fetched for user 9b2c2733b2f342579613f078f638a9ae. {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[089a0c48-5d10-4741-9205-6e2b5f6fcdef]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_b11j9z3pdevstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:13 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.20173761-e637-4a9c-9d4c-f6f9c613cd3d Feb 27 02:08:13 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:13 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f 1G" returned: 0 in 0.766s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:13 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f Feb 27 02:08:13 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:13 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_b11j9z3pdevstack@QuobyteHD Feb 27 02:08:13 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:13 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c3244111-4d58-461b-bfb4-d56b9c2134bd tempest-VolumesListTestJSON-194557610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0fe5b159-59f1-4a8f-97e1-517788dbb8b4" returned: 0 in 0.675s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c3244111-4d58-461b-bfb4-d56b9c2134bd tempest-VolumesListTestJSON-194557610 None] Lock "cinder-quobyte-0fe5b159-59f1-4a8f-97e1-517788dbb8b4" released by "delete_volume" :: held 1.528s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-c3244111-4d58-461b-bfb4-d56b9c2134bd tempest-VolumesListTestJSON-194557610 None] Created reservations ['618ce1e0-bbc3-4c56-994f-2eb41d0b8c34', '00270ae6-df32-4a8b-8763-1827ba7a315f', '2397a919-9627-41c3-a379-0ceafa6b4ca0', '50738432-791b-4e1c-9dc8-f613e09b628b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:13 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f" returned: 0 in 0.541s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:13 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f is being set with open permissions: ugo+rw Feb 27 02:08:13 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.20173761-e637-4a9c-9d4c-f6f9c613cd3d" returned: 0 in 0.705s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:13 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f Feb 27 02:08:13 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:13 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_b11j9z3pdevstack@QuobyteHD" returned: 0 in 0.623s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[81759e94-1121-4fee-b3eb-50c6cf615df4]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c3244111-4d58-461b-bfb4-d56b9c2134bd tempest-VolumesListTestJSON-194557610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c3244111-4d58-461b-bfb4-d56b9c2134bd tempest-VolumesListTestJSON-194557610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c3244111-4d58-461b-bfb4-d56b9c2134bd tempest-VolumesListTestJSON-194557610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c3244111-4d58-461b-bfb4-d56b9c2134bd tempest-VolumesListTestJSON-194557610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c3244111-4d58-461b-bfb4-d56b9c2134bd tempest-VolumesListTestJSON-194557610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c3244111-4d58-461b-bfb4-d56b9c2134bd tempest-VolumesListTestJSON-194557610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:14 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:08:14 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:14 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8 Feb 27 02:08:14 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:14 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f" returned: 0 in 0.523s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:14 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.info Feb 27 02:08:14 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:14 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c3244111-4d58-461b-bfb4-d56b9c2134bd tempest-VolumesListTestJSON-194557610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.567s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:14 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-c3244111-4d58-461b-bfb4-d56b9c2134bd tempest-VolumesListTestJSON-194557610 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:14 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c3244111-4d58-461b-bfb4-d56b9c2134bd tempest-VolumesListTestJSON-194557610 None] Deleted volume successfully. Feb 27 02:08:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c3244111-4d58-461b-bfb4-d56b9c2134bd tempest-VolumesListTestJSON-194557610 None] Lock "cinder-0fe5b159-59f1-4a8f-97e1-517788dbb8b4-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:14 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8" returned: 0 in 0.678s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.20173761-e637-4a9c-9d4c-f6f9c613cd3d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:14 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.20173761-e637-4a9c-9d4c-f6f9c613cd3d Feb 27 02:08:14 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:15 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.info" returned: 0 in 0.733s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:15 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.info is being set with open permissions: ugo+rw Feb 27 02:08:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:15 devstack sudo[88668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.info Feb 27 02:08:15 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:15 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.20173761-e637-4a9c-9d4c-f6f9c613cd3d" returned: 0 in 0.657s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.20173761-e637-4a9c-9d4c-f6f9c613cd3d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:15 devstack sudo[88670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.20173761-e637-4a9c-9d4c-f6f9c613cd3d Feb 27 02:08:15 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:15 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.info" returned: 0 in 0.644s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Acquiring lock "cinder-quobyte-5d81d884-1568-4bf0-bd4a-d95a438ec45d" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Lock "cinder-quobyte-5d81d884-1568-4bf0-bd4a-d95a438ec45d" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] snapshot: ade3ed68-9a64-489a-9864-d7fc23a2342f, volume: 5d81d884-1568-4bf0-bd4a-d95a438ec45d, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:08:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:15 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:15 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d211e389-2f6a-46a7-8c1b-9a92c4493c88]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8.20173761-e637-4a9c-9d4c-f6f9c613cd3d" returned: 0 in 0.609s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-20173761-e637-4a9c-9d4c-f6f9c613cd3d" released by "_delete_snapshot" :: held 2.751s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-ba650aab-223b-4d5c-94d1-d7ad720e53e8" released by "delete_snapshot" :: held 2.796s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:16 devstack cinder-volume[83167]: WARNING cinder.quota [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1801440973 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1801440973, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:08:16 devstack cinder-volume[83167]: WARNING cinder.quota [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1801440973 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1801440973, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:08:16 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f Feb 27 02:08:16 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:16 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] Created reservations ['ad46a992-3881-4c6d-9885-b8040eaf9729', '058c6ec2-ae66-48e1-97f9-26e9e00db13f', '6947c71d-dbfc-49ff-9033-4fa2ff3933a1', 'c2cd57b3-5fac-4cbb-a0f5-9aae20fbadcf'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:16 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ae9aa149-ce6d-426d-8f51-f736d1d13bca tempest-GroupSnapshotsTest-336945538 None] group_snapshot 059ac25d-63cd-41e9-b1a1-94a75b3594f4: deleted successfully Feb 27 02:08:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f029df9e-f087-42d9-9a25-7dbca19ab8b0 tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "cinder-quobyte-ba650aab-223b-4d5c-94d1-d7ad720e53e8" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f029df9e-f087-42d9-9a25-7dbca19ab8b0 tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-ba650aab-223b-4d5c-94d1-d7ad720e53e8" acquired by "delete_volume" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:16 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:16 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bb8f63-ac1f-460f-8193-f25d74daf348]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f029df9e-f087-42d9-9a25-7dbca19ab8b0 tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f" returned: 0 in 0.810s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:08:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:08:16 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4227bf5a-1899-431c-a750-4c29dfac77f8]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:16 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8 Feb 27 02:08:16 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:16 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 Feb 27 02:08:16 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:17 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Flow 'volume_create_manager' (42f873b1-f9d5-469f-8ab3-ed68e06e0dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e30c1c7-a558-4017-bcb6-9000efb3101b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e30c1c7-a558-4017-bcb6-9000efb3101b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1672790577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512fb587-cc9d-4922-acb2-6e099d00494e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f8b09d47614f76af1334bea47cff75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:17Z,use_quota=True,user_id='63aee6aefde3479e9d6d4642de700a21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f059a734-1df0-43d6-876d-7b0535a4043e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f059a734-1df0-43d6-876d-7b0535a4043e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97cef258-df3b-493c-9976-88bd303aace9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97cef258-df3b-493c-9976-88bd303aace9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '512fb587-cc9d-4922-acb2-6e099d00494e', 'volume_name': 'volume-512fb587-cc9d-4922-acb2-6e099d00494e', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1790898-9183-4c32-b3bf-a2f0b6ae3513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1790898-9183-4c32-b3bf-a2f0b6ae3513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4044f74a-0efb-4a7d-8e09-f0805faae464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:17 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Volume 512fb587-cc9d-4922-acb2-6e099d00494e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-512fb587-cc9d-4922-acb2-6e099d00494e', 'volume_size': 1} Feb 27 02:08:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:17 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f029df9e-f087-42d9-9a25-7dbca19ab8b0 tempest-GroupSnapshotsTest-336945538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8" returned: 0 in 0.662s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f029df9e-f087-42d9-9a25-7dbca19ab8b0 tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:17 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459" returned: 0 in 0.644s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:17 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Path /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d81d884-1568-4bf0-bd4a-d95a438ec45d not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:08:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d81d884-1568-4bf0-bd4a-d95a438ec45d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:17 devstack sudo[88690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8 Feb 27 02:08:17 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:17 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d81d884-1568-4bf0-bd4a-d95a438ec45d Feb 27 02:08:17 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:17 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f029df9e-f087-42d9-9a25-7dbca19ab8b0 tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ba650aab-223b-4d5c-94d1-d7ad720e53e8" returned: 0 in 0.509s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f029df9e-f087-42d9-9a25-7dbca19ab8b0 tempest-GroupSnapshotsTest-336945538 None] Lock "cinder-quobyte-ba650aab-223b-4d5c-94d1-d7ad720e53e8" released by "delete_volume" :: held 1.233s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:17 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-f029df9e-f087-42d9-9a25-7dbca19ab8b0 tempest-GroupSnapshotsTest-336945538 None] Created reservations ['8a4f5de5-94ab-4617-b94c-1579a8203a5b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:18 devstack cinder-volume[83167]: WARNING cinder.quota [None req-f029df9e-f087-42d9-9a25-7dbca19ab8b0 tempest-GroupSnapshotsTest-336945538 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1801440973 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1801440973, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:08:18 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-f029df9e-f087-42d9-9a25-7dbca19ab8b0 tempest-GroupSnapshotsTest-336945538 None] Created reservations ['dda5f8e8-33c5-4960-934c-38383551d302', '25e6427b-42a0-4056-b146-2570094c642a', '8edb1172-4fe5-441d-81f6-d216b7d0c7e2', '156b4ab0-01cd-41d9-a283-681a8ad6a76b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f029df9e-f087-42d9-9a25-7dbca19ab8b0 tempest-GroupSnapshotsTest-336945538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f029df9e-f087-42d9-9a25-7dbca19ab8b0 tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f029df9e-f087-42d9-9a25-7dbca19ab8b0 tempest-GroupSnapshotsTest-336945538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f029df9e-f087-42d9-9a25-7dbca19ab8b0 tempest-GroupSnapshotsTest-336945538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f029df9e-f087-42d9-9a25-7dbca19ab8b0 tempest-GroupSnapshotsTest-336945538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f029df9e-f087-42d9-9a25-7dbca19ab8b0 tempest-GroupSnapshotsTest-336945538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:18 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:08:18 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:19 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f029df9e-f087-42d9-9a25-7dbca19ab8b0 tempest-GroupSnapshotsTest-336945538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 1.423s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:19 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-f029df9e-f087-42d9-9a25-7dbca19ab8b0 tempest-GroupSnapshotsTest-336945538 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:19 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f029df9e-f087-42d9-9a25-7dbca19ab8b0 tempest-GroupSnapshotsTest-336945538 None] Delete group completed successfully. Feb 27 02:08:20 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d81d884-1568-4bf0-bd4a-d95a438ec45d" returned: 0 in 2.969s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:20 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd14d62-46ba-41b7-9160-022ca094a0c4]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:20 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 Feb 27 02:08:20 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:21 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459" returned: 0 in 0.903s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:21 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Image conversion details: src /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459, size 1024.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d81d884-1568-4bf0-bd4a-d95a438ec45d {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:08:21 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Converted 1024.00 MB image at 344.73 MB/s Feb 27 02:08:21 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d81d884-1568-4bf0-bd4a-d95a438ec45d is being set with open permissions: ugo+rw Feb 27 02:08:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d81d884-1568-4bf0-bd4a-d95a438ec45d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:21 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d81d884-1568-4bf0-bd4a-d95a438ec45d Feb 27 02:08:21 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:21 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d81d884-1568-4bf0-bd4a-d95a438ec45d" returned: 0 in 0.556s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Lock "cinder-quobyte-5d81d884-1568-4bf0-bd4a-d95a438ec45d" released by "_copy_volume_from_snapshot" :: held 5.970s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Acquiring lock "cinder-quobyte-ade3ed68-9a64-489a-9864-d7fc23a2342f" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Lock "cinder-quobyte-ade3ed68-9a64-489a-9864-d7fc23a2342f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Deleting offline snapshot ade3ed68-9a64-489a-9864-d7fc23a2342f of volume a145f91c-c34b-45a6-ae0b-e2550fb3c459 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:08:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] snapshot_file for this snap is: volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:08:21 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3221f3fc-6322-408f-ac03-4bee6838b5d2]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:22 devstack sudo[88717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f Feb 27 02:08:22 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:22 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f" returned: 0 in 0.623s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:22 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[51764383-5cc0-4b47-a936-e5f4b93ccf82]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:22 devstack sudo[88722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 Feb 27 02:08:22 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:23 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459" returned: 0 in 0.692s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:23 devstack sudo[88727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f Feb 27 02:08:23 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:23 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f" returned: 0 in 0.642s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:23 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f Feb 27 02:08:23 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:24 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459.ade3ed68-9a64-489a-9864-d7fc23a2342f" returned: 0 in 0.529s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:24 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Lock "cinder-quobyte-ade3ed68-9a64-489a-9864-d7fc23a2342f" released by "_delete_snapshot" :: held 2.563s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.755s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.510s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1377500555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93f64229-8086-4c96-b77f-d8b121660f5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c3284d3b2bc4fc7974034a5d4392b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:12Z,use_quota=True,user_id='9b2c2733b2f342579613f078f638a9ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Creating volume 93f64229-8086-4c96-b77f-d8b121660f5c {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:24 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:08:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c668d4-c64d-476a-834b-e5264bed90a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d81d884-1568-4bf0-bd4a-d95a438ec45d', 'volume_size': 1, 'source_volid': 'a145f91c-c34b-45a6-ae0b-e2550fb3c459', 'source_volstatus': 'available'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e46773-63b4-4688-9998-a3afa2666f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:24 devstack sudo[88735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c 1073741824 Feb 27 02:08:24 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:24 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Volume volume-5d81d884-1568-4bf0-bd4a-d95a438ec45d (5d81d884-1568-4bf0-bd4a-d95a438ec45d): created successfully Feb 27 02:08:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e46773-63b4-4688-9998-a3afa2666f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Flow 'volume_create_manager' (9b562473-458b-4798-a34b-1026f6754ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:24 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e7f39827-484e-4eec-ba1a-f302f6c9abda tempest-VolumeDependencyTests-60775104 None] Created volume successfully. Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-26cc7f2c-f8e9-43e6-b960-e68e98392c07 tempest-VolumeDependencyTests-60775104 None] Acquiring lock "cinder-a145f91c-c34b-45a6-ae0b-e2550fb3c459-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-26cc7f2c-f8e9-43e6-b960-e68e98392c07 tempest-VolumeDependencyTests-60775104 None] Lock "cinder-a145f91c-c34b-45a6-ae0b-e2550fb3c459-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-26cc7f2c-f8e9-43e6-b960-e68e98392c07 tempest-VolumeDependencyTests-60775104 None] Acquiring lock "cinder-quobyte-a145f91c-c34b-45a6-ae0b-e2550fb3c459" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-26cc7f2c-f8e9-43e6-b960-e68e98392c07 tempest-VolumeDependencyTests-60775104 None] Lock "cinder-quobyte-a145f91c-c34b-45a6-ae0b-e2550fb3c459" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:25 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c 1073741824" returned: 0 in 0.742s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fee53a6-12e9-4c0e-aa62-d4ed6a0a2b91]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-26cc7f2c-f8e9-43e6-b960-e68e98392c07 tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:25 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c Feb 27 02:08:25 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:25 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 Feb 27 02:08:25 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:25 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c" returned: 0 in 0.466s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.470s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1672790577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512fb587-cc9d-4922-acb2-6e099d00494e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94f8b09d47614f76af1334bea47cff75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:17Z,use_quota=True,user_id='63aee6aefde3479e9d6d4642de700a21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Creating volume 512fb587-cc9d-4922-acb2-6e099d00494e {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:25 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-512fb587-cc9d-4922-acb2-6e099d00494e 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Attempting download of 74e16fab-69df-4cb3-99da-0b06bc338767 ((None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}])) to volume 93f64229-8086-4c96-b77f-d8b121660f5c. {{(pid=83167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 02:08:25 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-512fb587-cc9d-4922-acb2-6e099d00494e 1073741824 Feb 27 02:08:25 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaff545e-f1b3-4360-8f14-c3756c7b27fc]: (4, 'raw') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_mc2s5o_9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:25 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-26cc7f2c-f8e9-43e6-b960-e68e98392c07 tempest-VolumeDependencyTests-60775104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459" returned: 0 in 0.642s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-26cc7f2c-f8e9-43e6-b960-e68e98392c07 tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:25 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459 Feb 27 02:08:25 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:25 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_mc2s5o_9 Feb 27 02:08:25 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:26 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_mc2s5o_9" returned: 0 in 0.558s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_mc2s5o_9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:26 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-26cc7f2c-f8e9-43e6-b960-e68e98392c07 tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a145f91c-c34b-45a6-ae0b-e2550fb3c459" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-26cc7f2c-f8e9-43e6-b960-e68e98392c07 tempest-VolumeDependencyTests-60775104 None] Lock "cinder-quobyte-a145f91c-c34b-45a6-ae0b-e2550fb3c459" released by "delete_volume" :: held 1.223s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:26 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-512fb587-cc9d-4922-acb2-6e099d00494e 1073741824" returned: 0 in 0.700s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:26 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-26cc7f2c-f8e9-43e6-b960-e68e98392c07 tempest-VolumeDependencyTests-60775104 None] Created reservations ['61fb8e78-2e83-42d0-a7dd-5f6b8c8fba44', '1702c551-daaf-45f6-bfa4-ae89757656b8', '5f4a906a-874e-4320-8c9d-41a5b1f0a358', '236a43e7-d964-4544-b31b-81e147aedc2f'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-512fb587-cc9d-4922-acb2-6e099d00494e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:26 devstack sudo[88761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_mc2s5o_9 Feb 27 02:08:26 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:26 devstack sudo[88763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-512fb587-cc9d-4922-acb2-6e099d00494e Feb 27 02:08:26 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-26cc7f2c-f8e9-43e6-b960-e68e98392c07 tempest-VolumeDependencyTests-60775104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-26cc7f2c-f8e9-43e6-b960-e68e98392c07 tempest-VolumeDependencyTests-60775104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-26cc7f2c-f8e9-43e6-b960-e68e98392c07 tempest-VolumeDependencyTests-60775104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-26cc7f2c-f8e9-43e6-b960-e68e98392c07 tempest-VolumeDependencyTests-60775104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-26cc7f2c-f8e9-43e6-b960-e68e98392c07 tempest-VolumeDependencyTests-60775104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-26cc7f2c-f8e9-43e6-b960-e68e98392c07 tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:26 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:08:26 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:26 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_mc2s5o_9" returned: 1 in 0.565s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_mc2s5o_9' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:08:26 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd233c2-d2c9-414e-a1d4-dfd1ab53f2b7]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_b11j9z3pdevstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:27 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-512fb587-cc9d-4922-acb2-6e099d00494e" returned: 0 in 0.510s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4044f74a-0efb-4a7d-8e09-f0805faae464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-512fb587-cc9d-4922-acb2-6e099d00494e', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb3977ec-1754-4715-888b-81d5ca0ef53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:27 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_b11j9z3pdevstack@QuobyteHD Feb 27 02:08:27 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:27 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Volume volume-512fb587-cc9d-4922-acb2-6e099d00494e (512fb587-cc9d-4922-acb2-6e099d00494e): created successfully Feb 27 02:08:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb3977ec-1754-4715-888b-81d5ca0ef53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Flow 'volume_create_manager' (42f873b1-f9d5-469f-8ab3-ed68e06e0dd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:27 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-9b9f8e85-d297-45fc-83eb-f464c808b96a tempest-VolumesNegativeTest-13968885 None] Created volume successfully. Feb 27 02:08:27 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-26cc7f2c-f8e9-43e6-b960-e68e98392c07 tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.557s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:27 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-26cc7f2c-f8e9-43e6-b960-e68e98392c07 tempest-VolumeDependencyTests-60775104 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:27 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-26cc7f2c-f8e9-43e6-b960-e68e98392c07 tempest-VolumeDependencyTests-60775104 None] Deleted volume successfully. Feb 27 02:08:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-26cc7f2c-f8e9-43e6-b960-e68e98392c07 tempest-VolumeDependencyTests-60775104 None] Lock "cinder-a145f91c-c34b-45a6-ae0b-e2550fb3c459-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-66545660-7d2f-4c7e-b70b-45c3fc0357dc tempest-VolumeDependencyTests-60775104 None] Acquiring lock "cinder-5d81d884-1568-4bf0-bd4a-d95a438ec45d-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-66545660-7d2f-4c7e-b70b-45c3fc0357dc tempest-VolumeDependencyTests-60775104 None] Lock "cinder-5d81d884-1568-4bf0-bd4a-d95a438ec45d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-66545660-7d2f-4c7e-b70b-45c3fc0357dc tempest-VolumeDependencyTests-60775104 None] Acquiring lock "cinder-quobyte-5d81d884-1568-4bf0-bd4a-d95a438ec45d" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-66545660-7d2f-4c7e-b70b-45c3fc0357dc tempest-VolumeDependencyTests-60775104 None] Lock "cinder-quobyte-5d81d884-1568-4bf0-bd4a-d95a438ec45d" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:27 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab339ae-4410-46d7-9531-75b1fb9e71b7]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-66545660-7d2f-4c7e-b70b-45c3fc0357dc tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d81d884-1568-4bf0-bd4a-d95a438ec45d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:27 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d81d884-1568-4bf0-bd4a-d95a438ec45d Feb 27 02:08:27 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:27 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_b11j9z3pdevstack@QuobyteHD" returned: 0 in 0.623s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:27 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] 74e16fab-69df-4cb3-99da-0b06bc338767 was qcow2, converting to raw {{(pid=83167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 02:08:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_b11j9z3pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:27 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_b11j9z3pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c Feb 27 02:08:27 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:28 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-66545660-7d2f-4c7e-b70b-45c3fc0357dc tempest-VolumeDependencyTests-60775104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d81d884-1568-4bf0-bd4a-d95a438ec45d" returned: 0 in 0.584s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-66545660-7d2f-4c7e-b70b-45c3fc0357dc tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d81d884-1568-4bf0-bd4a-d95a438ec45d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:28 devstack sudo[88787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d81d884-1568-4bf0-bd4a-d95a438ec45d Feb 27 02:08:28 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:28 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-66545660-7d2f-4c7e-b70b-45c3fc0357dc tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d81d884-1568-4bf0-bd4a-d95a438ec45d" returned: 0 in 0.639s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-66545660-7d2f-4c7e-b70b-45c3fc0357dc tempest-VolumeDependencyTests-60775104 None] Lock "cinder-quobyte-5d81d884-1568-4bf0-bd4a-d95a438ec45d" released by "delete_volume" :: held 1.253s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:28 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-66545660-7d2f-4c7e-b70b-45c3fc0357dc tempest-VolumeDependencyTests-60775104 None] Created reservations ['0264b3aa-089e-45d7-a105-f76a889df129', '53557d30-90b6-49fd-bf96-58e5970cb598', '8f42a3c9-3194-4943-b332-89cd09b4e86a', '161a1eb0-0e35-460b-9f17-199bb6ad7cd0'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-66545660-7d2f-4c7e-b70b-45c3fc0357dc tempest-VolumeDependencyTests-60775104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-66545660-7d2f-4c7e-b70b-45c3fc0357dc tempest-VolumeDependencyTests-60775104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-66545660-7d2f-4c7e-b70b-45c3fc0357dc tempest-VolumeDependencyTests-60775104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-66545660-7d2f-4c7e-b70b-45c3fc0357dc tempest-VolumeDependencyTests-60775104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-66545660-7d2f-4c7e-b70b-45c3fc0357dc tempest-VolumeDependencyTests-60775104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-66545660-7d2f-4c7e-b70b-45c3fc0357dc tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:28 devstack sudo[88803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:08:28 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:29 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_b11j9z3pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c" returned: 0 in 1.442s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:29 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_b11j9z3pdevstack@QuobyteHD, size 112.00 MB, duration 1.44 sec, destination /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:08:29 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Converted 112.00 MB image at 77.56 MB/s Feb 27 02:08:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:29 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c 1G Feb 27 02:08:29 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:29 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-66545660-7d2f-4c7e-b70b-45c3fc0357dc tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.531s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:29 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-66545660-7d2f-4c7e-b70b-45c3fc0357dc tempest-VolumeDependencyTests-60775104 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:29 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-66545660-7d2f-4c7e-b70b-45c3fc0357dc tempest-VolumeDependencyTests-60775104 None] Deleted volume successfully. Feb 27 02:08:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-66545660-7d2f-4c7e-b70b-45c3fc0357dc tempest-VolumeDependencyTests-60775104 None] Lock "cinder-5d81d884-1568-4bf0-bd4a-d95a438ec45d-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:29 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c 1G" returned: 0 in 0.528s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:29 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[998382d6-94e4-4859-a89d-6e071709e442]: (4, 'raw') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:29 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c Feb 27 02:08:29 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c02e0b46-fb77-4043-8054-c2a9fbbe1dfe tempest-VolumeDependencyTests-60775104 None] Acquiring lock "cinder-0d34bf79-de57-41f7-a310-013f8f1bf960-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c02e0b46-fb77-4043-8054-c2a9fbbe1dfe tempest-VolumeDependencyTests-60775104 None] Lock "cinder-0d34bf79-de57-41f7-a310-013f8f1bf960-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c02e0b46-fb77-4043-8054-c2a9fbbe1dfe tempest-VolumeDependencyTests-60775104 None] Acquiring lock "cinder-quobyte-0d34bf79-de57-41f7-a310-013f8f1bf960" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c02e0b46-fb77-4043-8054-c2a9fbbe1dfe tempest-VolumeDependencyTests-60775104 None] Lock "cinder-quobyte-0d34bf79-de57-41f7-a310-013f8f1bf960" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:29 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07bb119-384f-40de-8c5d-0b2d68972240]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c02e0b46-fb77-4043-8054-c2a9fbbe1dfe tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0d34bf79-de57-41f7-a310-013f8f1bf960 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:29 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0d34bf79-de57-41f7-a310-013f8f1bf960 Feb 27 02:08:29 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:30 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c" returned: 0 in 0.638s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:30 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c Feb 27 02:08:30 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:30 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c02e0b46-fb77-4043-8054-c2a9fbbe1dfe tempest-VolumeDependencyTests-60775104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0d34bf79-de57-41f7-a310-013f8f1bf960" returned: 0 in 0.648s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c02e0b46-fb77-4043-8054-c2a9fbbe1dfe tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0d34bf79-de57-41f7-a310-013f8f1bf960 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:30 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0d34bf79-de57-41f7-a310-013f8f1bf960 Feb 27 02:08:30 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:30 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:08:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:30 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c" returned: 1 in 0.718s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:08:30 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Downloaded image 74e16fab-69df-4cb3-99da-0b06bc338767 ((None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}])) to volume 93f64229-8086-4c96-b77f-d8b121660f5c successfully. {{(pid=83167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 02:08:30 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:08:30 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Temporary image 74e16fab-69df-4cb3-99da-0b06bc338767 for user 9b2c2733b2f342579613f078f638a9ae is deleted. {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 02:08:30 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:30 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Marking volume 93f64229-8086-4c96-b77f-d8b121660f5c as bootable. {{(pid=83167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 02:08:30 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Copying metadata from image 74e16fab-69df-4cb3-99da-0b06bc338767 to 93f64229-8086-4c96-b77f-d8b121660f5c. {{(pid=83167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 02:08:30 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Creating volume glance metadata for volume 93f64229-8086-4c96-b77f-d8b121660f5c backed by image 74e16fab-69df-4cb3-99da-0b06bc338767 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 02:08:31 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c02e0b46-fb77-4043-8054-c2a9fbbe1dfe tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0d34bf79-de57-41f7-a310-013f8f1bf960" returned: 0 in 0.479s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c02e0b46-fb77-4043-8054-c2a9fbbe1dfe tempest-VolumeDependencyTests-60775104 None] Lock "cinder-quobyte-0d34bf79-de57-41f7-a310-013f8f1bf960" released by "delete_volume" :: held 1.155s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9608fa6e-6c6e-4add-b4d7-39e1db5e68c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93f64229-8086-4c96-b77f-d8b121660f5c', 'volume_size': 1, 'image_id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c3ebea7eea44d62b013a3b663b3a45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74e16fab-69df-4cb3-99da-0b06bc338767/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d81fccb-9dfb-4c06-94b5-d66a72a0daf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:31 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Volume volume-93f64229-8086-4c96-b77f-d8b121660f5c (93f64229-8086-4c96-b77f-d8b121660f5c): created successfully Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d81fccb-9dfb-4c06-94b5-d66a72a0daf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Flow 'volume_create_manager' (b2824ba6-1dff-49fe-bb72-c5bca3a34967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:31 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-720c5fee-307e-464f-8042-94d4a0adfaef tempest-VolumesExtendTest-611769720 None] Created volume successfully. Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-c02e0b46-fb77-4043-8054-c2a9fbbe1dfe tempest-VolumeDependencyTests-60775104 None] Created reservations ['d6e9fba4-02b4-4376-8b1f-11be7388265e', '7d665f56-af2a-4697-82ac-9d8dbd6ac85c', '7382c6d0-004b-41a2-be90-b60576e35d8b', '3d7faf23-4a83-4372-af89-7933506bc2df'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c02e0b46-fb77-4043-8054-c2a9fbbe1dfe tempest-VolumeDependencyTests-60775104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c02e0b46-fb77-4043-8054-c2a9fbbe1dfe tempest-VolumeDependencyTests-60775104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c02e0b46-fb77-4043-8054-c2a9fbbe1dfe tempest-VolumeDependencyTests-60775104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c02e0b46-fb77-4043-8054-c2a9fbbe1dfe tempest-VolumeDependencyTests-60775104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c02e0b46-fb77-4043-8054-c2a9fbbe1dfe tempest-VolumeDependencyTests-60775104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c02e0b46-fb77-4043-8054-c2a9fbbe1dfe tempest-VolumeDependencyTests-60775104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:31 devstack sudo[88830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:08:31 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:31 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.592s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-97eb9eba-b69f-420e-830b-f7440419e0bc tempest-VolumesExtendTest-611769720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-97eb9eba-b69f-420e-830b-f7440419e0bc tempest-VolumesExtendTest-611769720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4851e1ab-979c-42cb-b637-9f71d4175f5f]: (4, 'raw') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-97eb9eba-b69f-420e-830b-f7440419e0bc tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:31 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c02e0b46-fb77-4043-8054-c2a9fbbe1dfe tempest-VolumeDependencyTests-60775104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.576s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-c02e0b46-fb77-4043-8054-c2a9fbbe1dfe tempest-VolumeDependencyTests-60775104 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:31 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c02e0b46-fb77-4043-8054-c2a9fbbe1dfe tempest-VolumeDependencyTests-60775104 None] Deleted volume successfully. Feb 27 02:08:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c02e0b46-fb77-4043-8054-c2a9fbbe1dfe tempest-VolumeDependencyTests-60775104 None] Lock "cinder-0d34bf79-de57-41f7-a310-013f8f1bf960-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:31 devstack sudo[88834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c Feb 27 02:08:31 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:32 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-97eb9eba-b69f-420e-830b-f7440419e0bc tempest-VolumesExtendTest-611769720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c" returned: 0 in 0.573s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-97eb9eba-b69f-420e-830b-f7440419e0bc tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:32 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c Feb 27 02:08:32 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:32 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-97eb9eba-b69f-420e-830b-f7440419e0bc tempest-VolumesExtendTest-611769720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c" returned: 1 in 0.624s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-97eb9eba-b69f-420e-830b-f7440419e0bc tempest-VolumesExtendTest-611769720 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:08:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-97eb9eba-b69f-420e-830b-f7440419e0bc tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c 2G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-97eb9eba-b69f-420e-830b-f7440419e0bc tempest-VolumesExtendTest-611769720 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c 2G" returned: 0 in 0.053s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-97eb9eba-b69f-420e-830b-f7440419e0bc tempest-VolumesExtendTest-611769720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.288s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:32 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-97eb9eba-b69f-420e-830b-f7440419e0bc tempest-VolumesExtendTest-611769720 None] Extend volume completed successfully. Feb 27 02:08:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] Acquiring lock "cinder-93f64229-8086-4c96-b77f-d8b121660f5c-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] Lock "cinder-93f64229-8086-4c96-b77f-d8b121660f5c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] Acquiring lock "cinder-quobyte-93f64229-8086-4c96-b77f-d8b121660f5c" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] Lock "cinder-quobyte-93f64229-8086-4c96-b77f-d8b121660f5c" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:34 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fbd47f-1b87-433d-8b63-0c4269323b70]: (4, 'raw') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:34 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c Feb 27 02:08:34 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:35 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c" returned: 0 in 0.773s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:35 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c Feb 27 02:08:35 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:35 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c" returned: 1 in 0.826s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:08:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:35 devstack sudo[88905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c Feb 27 02:08:35 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:36 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-93f64229-8086-4c96-b77f-d8b121660f5c" returned: 0 in 0.580s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] Lock "cinder-quobyte-93f64229-8086-4c96-b77f-d8b121660f5c" released by "delete_volume" :: held 2.275s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:36 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] Created reservations ['9825ff9e-db7c-41f0-b93d-bc0eb81c0792', '76e8adb6-3145-4652-a47d-d0a7ada577c5', 'c7a52dec-5b75-4fc7-aef9-c6c36bac7b02', 'ac9bee5e-4abb-476b-aa65-f94d4e88fb99'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:36 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:08:36 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:37 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.697s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:37 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] Deleted volume successfully. Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-704e883f-8753-4214-822e-265613a6244b tempest-VolumesExtendTest-611769720 None] Lock "cinder-93f64229-8086-4c96-b77f-d8b121660f5c-delete_volume" released by "delete_volume" :: held 3.256s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Flow 'volume_create_manager' (cf2bd39b-8de5-4ae2-9ef4-223023daec69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d101cc7-06bb-4b9d-bd03-a507c3357179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d101cc7-06bb-4b9d-bd03-a507c3357179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1308784967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bda0a2-9d7e-44ec-87bb-de7da73626d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c3284d3b2bc4fc7974034a5d4392b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:38Z,use_quota=True,user_id='9b2c2733b2f342579613f078f638a9ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba142909-2dd2-43f9-b688-b2f2ba9ae763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba142909-2dd2-43f9-b688-b2f2ba9ae763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946083cf-0796-4287-b953-f8465d587404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946083cf-0796-4287-b953-f8465d587404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59bda0a2-9d7e-44ec-87bb-de7da73626d6', 'volume_name': 'volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25b5cce-1044-4be1-a4e9-55535e6304c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25b5cce-1044-4be1-a4e9-55535e6304c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (252e3f0e-2df9-408b-ba04-5541282f2d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:37 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Volume 59bda0a2-9d7e-44ec-87bb-de7da73626d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6', 'volume_size': 1} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1308784967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bda0a2-9d7e-44ec-87bb-de7da73626d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c3284d3b2bc4fc7974034a5d4392b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:38Z,use_quota=True,user_id='9b2c2733b2f342579613f078f638a9ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Creating volume 59bda0a2-9d7e-44ec-87bb-de7da73626d6 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:37 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:08:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:37 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6 1073741824 Feb 27 02:08:37 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:38 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6 1073741824" returned: 0 in 0.851s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:38 devstack sudo[88923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6 Feb 27 02:08:38 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:39 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6" returned: 0 in 0.623s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (252e3f0e-2df9-408b-ba04-5541282f2d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6746ccc9-def2-4ddd-ac5e-8fa2a6132662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:39 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Volume volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6 (59bda0a2-9d7e-44ec-87bb-de7da73626d6): created successfully Feb 27 02:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6746ccc9-def2-4ddd-ac5e-8fa2a6132662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Flow 'volume_create_manager' (cf2bd39b-8de5-4ae2-9ef4-223023daec69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:39 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a4935b86-93e3-49d2-91ef-14708c30f9f9 tempest-VolumesExtendTest-611769720 None] Created volume successfully. Feb 27 02:08:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1e0a411b-353b-4111-b182-56c2587177f0 tempest-VolumesExtendTest-611769720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1e0a411b-353b-4111-b182-56c2587177f0 tempest-VolumesExtendTest-611769720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-1e0a411b-353b-4111-b182-56c2587177f0 tempest-VolumesExtendTest-611769720 None] Creating offline snapshot 30b1c82d-920d-4d5b-887e-c9c412b212a1 of volume 59bda0a2-9d7e-44ec-87bb-de7da73626d6 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:40 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ae5aff-73e4-4b6a-8107-61adee529c0c]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1e0a411b-353b-4111-b182-56c2587177f0 tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:40 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6 Feb 27 02:08:40 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:40 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1e0a411b-353b-4111-b182-56c2587177f0 tempest-VolumesExtendTest-611769720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6" returned: 0 in 0.732s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1e0a411b-353b-4111-b182-56c2587177f0 tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:40 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1 1G Feb 27 02:08:40 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:41 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1e0a411b-353b-4111-b182-56c2587177f0 tempest-VolumesExtendTest-611769720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1 1G" returned: 0 in 0.787s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1e0a411b-353b-4111-b182-56c2587177f0 tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:41 devstack sudo[88939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1 Feb 27 02:08:41 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:42 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1e0a411b-353b-4111-b182-56c2587177f0 tempest-VolumesExtendTest-611769720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1" returned: 0 in 0.649s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:42 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-1e0a411b-353b-4111-b182-56c2587177f0 tempest-VolumesExtendTest-611769720 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1 is being set with open permissions: ugo+rw Feb 27 02:08:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1e0a411b-353b-4111-b182-56c2587177f0 tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:42 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1 Feb 27 02:08:42 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:43 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1e0a411b-353b-4111-b182-56c2587177f0 tempest-VolumesExtendTest-611769720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1" returned: 0 in 0.828s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1e0a411b-353b-4111-b182-56c2587177f0 tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:43 devstack sudo[88972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.info Feb 27 02:08:43 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:43 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1e0a411b-353b-4111-b182-56c2587177f0 tempest-VolumesExtendTest-611769720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.info" returned: 0 in 0.676s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:43 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-1e0a411b-353b-4111-b182-56c2587177f0 tempest-VolumesExtendTest-611769720 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.info is being set with open permissions: ugo+rw Feb 27 02:08:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1e0a411b-353b-4111-b182-56c2587177f0 tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:43 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.info Feb 27 02:08:43 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:44 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1e0a411b-353b-4111-b182-56c2587177f0 tempest-VolumesExtendTest-611769720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.info" returned: 0 in 0.523s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1e0a411b-353b-4111-b182-56c2587177f0 tempest-VolumesExtendTest-611769720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.312s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:44 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1e0a411b-353b-4111-b182-56c2587177f0 tempest-VolumesExtendTest-611769720 None] Create snapshot completed successfully Feb 27 02:08:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-32807760-5826-489f-9b24-12bce4244250 tempest-VolumesExtendTest-611769720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-32807760-5826-489f-9b24-12bce4244250 tempest-VolumesExtendTest-611769720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:45 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c41f7b-4a3e-4bc6-9689-f0a9a6870934]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-32807760-5826-489f-9b24-12bce4244250 tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:45 devstack sudo[88978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6 Feb 27 02:08:45 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:46 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-32807760-5826-489f-9b24-12bce4244250 tempest-VolumesExtendTest-611769720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6" returned: 0 in 0.625s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-32807760-5826-489f-9b24-12bce4244250 tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1 2G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-32807760-5826-489f-9b24-12bce4244250 tempest-VolumesExtendTest-611769720 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1 2G" returned: 0 in 0.086s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-32807760-5826-489f-9b24-12bce4244250 tempest-VolumesExtendTest-611769720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.734s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:46 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-32807760-5826-489f-9b24-12bce4244250 tempest-VolumesExtendTest-611769720 None] Extend volume completed successfully. Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Flow 'volume_create_manager' (434b9705-eb00-4974-84d6-4536d0012679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04fcac1-dcac-46c8-8bd3-101147b86fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04fcac1-dcac-46c8-8bd3-101147b86fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1068011610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3ba275-8436-41ec-9fae-9787bfd0ece2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a12bcf690ed4f50b23c76546b43ced9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:46Z,use_quota=True,user_id='e099b174765f4df998243848f7c0d043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94a6e448-13a7-418a-98b7-52695d1d798c),volume_type_id=94a6e448-13a7-418a-98b7-52695d1d798c)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98619ce7-053e-41a8-83e7-410ce750c1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98619ce7-053e-41a8-83e7-410ce750c1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (848abe55-e821-497a-899a-92b0d99667b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (848abe55-e821-497a-899a-92b0d99667b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f3ba275-8436-41ec-9fae-9787bfd0ece2', 'volume_name': 'volume-6f3ba275-8436-41ec-9fae-9787bfd0ece2', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a81457b-ef7b-4966-af79-40f3f7a5e647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a81457b-ef7b-4966-af79-40f3f7a5e647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ec688c-2134-4f56-b57f-66cd66416eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:46 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Volume 6f3ba275-8436-41ec-9fae-9787bfd0ece2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f3ba275-8436-41ec-9fae-9787bfd0ece2', 'volume_size': 1} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1068011610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3ba275-8436-41ec-9fae-9787bfd0ece2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a12bcf690ed4f50b23c76546b43ced9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:46Z,use_quota=True,user_id='e099b174765f4df998243848f7c0d043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94a6e448-13a7-418a-98b7-52695d1d798c),volume_type_id=94a6e448-13a7-418a-98b7-52695d1d798c)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Creating volume 6f3ba275-8436-41ec-9fae-9787bfd0ece2 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:46 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6f3ba275-8436-41ec-9fae-9787bfd0ece2 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:46 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6f3ba275-8436-41ec-9fae-9787bfd0ece2 1073741824 Feb 27 02:08:46 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] Acquiring lock "cinder-30b1c82d-920d-4d5b-887e-c9c412b212a1-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] Lock "cinder-30b1c82d-920d-4d5b-887e-c9c412b212a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] Acquiring lock "cinder-quobyte-59bda0a2-9d7e-44ec-87bb-de7da73626d6" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] Lock "cinder-quobyte-59bda0a2-9d7e-44ec-87bb-de7da73626d6" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] Acquiring lock "cinder-quobyte-30b1c82d-920d-4d5b-887e-c9c412b212a1" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] Lock "cinder-quobyte-30b1c82d-920d-4d5b-887e-c9c412b212a1" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] Deleting offline snapshot 30b1c82d-920d-4d5b-887e-c9c412b212a1 of volume 59bda0a2-9d7e-44ec-87bb-de7da73626d6 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] snapshot_file for this snap is: volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b39a5a-5739-4d2d-99c6-b8b6b21c3433]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:46 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1 Feb 27 02:08:46 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:47 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6f3ba275-8436-41ec-9fae-9787bfd0ece2 1073741824" returned: 0 in 0.629s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6f3ba275-8436-41ec-9fae-9787bfd0ece2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:47 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6f3ba275-8436-41ec-9fae-9787bfd0ece2 Feb 27 02:08:47 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:47 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1" returned: 0 in 0.598s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:47 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[325ed7c1-cf63-4aef-ac0f-acb683578b43]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:47 devstack sudo[88998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6 Feb 27 02:08:47 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:47 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6f3ba275-8436-41ec-9fae-9787bfd0ece2" returned: 0 in 0.497s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ec688c-2134-4f56-b57f-66cd66416eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f3ba275-8436-41ec-9fae-9787bfd0ece2', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e4b813-58be-4301-8e29-245cf0c2fdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:47 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Volume volume-6f3ba275-8436-41ec-9fae-9787bfd0ece2 (6f3ba275-8436-41ec-9fae-9787bfd0ece2): created successfully Feb 27 02:08:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e4b813-58be-4301-8e29-245cf0c2fdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Flow 'volume_create_manager' (434b9705-eb00-4974-84d6-4536d0012679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:47 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-fcb8a25f-fb19-4f3a-acdc-5f7711cec2dd tempest-VolumeTypesAccessTest-1730125254 None] Created volume successfully. Feb 27 02:08:47 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6" returned: 0 in 0.569s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:47 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1 Feb 27 02:08:47 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:48 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1" returned: 0 in 0.678s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:48 devstack sudo[89010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1 Feb 27 02:08:48 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] Acquiring lock "cinder-6f3ba275-8436-41ec-9fae-9787bfd0ece2-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] Lock "cinder-6f3ba275-8436-41ec-9fae-9787bfd0ece2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] Acquiring lock "cinder-quobyte-6f3ba275-8436-41ec-9fae-9787bfd0ece2" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] Lock "cinder-quobyte-6f3ba275-8436-41ec-9fae-9787bfd0ece2" acquired by "delete_volume" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:48 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0547dd-4bd4-4608-be07-2c815a7f1a33]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6f3ba275-8436-41ec-9fae-9787bfd0ece2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:48 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6f3ba275-8436-41ec-9fae-9787bfd0ece2 Feb 27 02:08:48 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:49 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6.30b1c82d-920d-4d5b-887e-c9c412b212a1" returned: 0 in 0.669s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] Lock "cinder-quobyte-30b1c82d-920d-4d5b-887e-c9c412b212a1" released by "_delete_snapshot" :: held 2.615s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] Lock "cinder-quobyte-59bda0a2-9d7e-44ec-87bb-de7da73626d6" released by "delete_snapshot" :: held 2.630s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:49 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] Created reservations ['c7169cd0-e055-43b2-b2fb-c49b58cbe3c1', 'ef07db57-c94b-49d9-8bad-bbca3f07156f', '1a9a9107-b1f6-4bb0-9ac7-8a180d52680d', '7656e9c0-2b9d-4348-b157-482a1dcae020'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:49 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] Delete snapshot completed successfully. Feb 27 02:08:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-081393d1-1c1f-4b69-8eb3-a57b68e4212c tempest-VolumesExtendTest-611769720 None] Lock "cinder-30b1c82d-920d-4d5b-887e-c9c412b212a1-delete_snapshot" released by "delete_snapshot" :: held 2.800s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:49 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6f3ba275-8436-41ec-9fae-9787bfd0ece2" returned: 0 in 0.661s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6f3ba275-8436-41ec-9fae-9787bfd0ece2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:49 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6f3ba275-8436-41ec-9fae-9787bfd0ece2 Feb 27 02:08:49 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9b980075-9e42-4143-bc44-32c72d60e84c tempest-VolumesExtendTest-611769720 None] Acquiring lock "cinder-59bda0a2-9d7e-44ec-87bb-de7da73626d6-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9b980075-9e42-4143-bc44-32c72d60e84c tempest-VolumesExtendTest-611769720 None] Lock "cinder-59bda0a2-9d7e-44ec-87bb-de7da73626d6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9b980075-9e42-4143-bc44-32c72d60e84c tempest-VolumesExtendTest-611769720 None] Acquiring lock "cinder-quobyte-59bda0a2-9d7e-44ec-87bb-de7da73626d6" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9b980075-9e42-4143-bc44-32c72d60e84c tempest-VolumesExtendTest-611769720 None] Lock "cinder-quobyte-59bda0a2-9d7e-44ec-87bb-de7da73626d6" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:50 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9410b8e-4246-47c4-a2bd-13cf17664420]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9b980075-9e42-4143-bc44-32c72d60e84c tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:50 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6 Feb 27 02:08:50 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:50 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-6f3ba275-8436-41ec-9fae-9787bfd0ece2" returned: 0 in 1.194s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] Lock "cinder-quobyte-6f3ba275-8436-41ec-9fae-9787bfd0ece2" released by "delete_volume" :: held 1.887s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:50 devstack cinder-volume[83167]: WARNING cinder.quota [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1521760456 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1521760456, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:08:50 devstack cinder-volume[83167]: WARNING cinder.quota [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1521760456 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1521760456, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:08:50 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] Created reservations ['41a69d74-8ede-4750-9e4e-b22904e8b51a', '6a4c288b-c47a-402e-bb69-f7906a3d4f2a', '96918251-241e-429d-aa74-a56da81e8772', '7e353ad2-5e40-46bb-8106-f8a7092a9b62'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:50 devstack sudo[89028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:08:50 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:51 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9b980075-9e42-4143-bc44-32c72d60e84c tempest-VolumesExtendTest-611769720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6" returned: 0 in 0.852s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9b980075-9e42-4143-bc44-32c72d60e84c tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:51 devstack sudo[89030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6 Feb 27 02:08:51 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:52 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 1.201s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:52 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:52 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] Deleted volume successfully. Feb 27 02:08:52 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:UPDATE=188,cinder:SELECT=141,cinder:INSERT=56,cinder:DELETE=9 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:08:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dc214a5e-25ec-4398-9ca0-cd88913c345c tempest-VolumeTypesAccessTest-1730125254 None] Lock "cinder-6f3ba275-8436-41ec-9fae-9787bfd0ece2-delete_volume" released by "delete_volume" :: held 3.400s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:52 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9b980075-9e42-4143-bc44-32c72d60e84c tempest-VolumesExtendTest-611769720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bda0a2-9d7e-44ec-87bb-de7da73626d6" returned: 0 in 1.360s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9b980075-9e42-4143-bc44-32c72d60e84c tempest-VolumesExtendTest-611769720 None] Lock "cinder-quobyte-59bda0a2-9d7e-44ec-87bb-de7da73626d6" released by "delete_volume" :: held 2.304s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:52 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:INSERT=45,cinder:UPDATE=174,cinder:SELECT=140,cinder:DELETE=12 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:08:52 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-9b980075-9e42-4143-bc44-32c72d60e84c tempest-VolumesExtendTest-611769720 None] Created reservations ['684a1f9f-3bcf-4985-a370-3fd68c3e77cb', 'f48cd781-da6e-459f-8f51-2388450d8542', '59aba79f-b3b9-4903-9ebc-31da3f9f9ed4', 'f3a3b128-1b81-4236-9342-896c5e4bd28f'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9b980075-9e42-4143-bc44-32c72d60e84c tempest-VolumesExtendTest-611769720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9b980075-9e42-4143-bc44-32c72d60e84c tempest-VolumesExtendTest-611769720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9b980075-9e42-4143-bc44-32c72d60e84c tempest-VolumesExtendTest-611769720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9b980075-9e42-4143-bc44-32c72d60e84c tempest-VolumesExtendTest-611769720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9b980075-9e42-4143-bc44-32c72d60e84c tempest-VolumesExtendTest-611769720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9b980075-9e42-4143-bc44-32c72d60e84c tempest-VolumesExtendTest-611769720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:52 devstack sudo[89034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:08:52 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:53 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9b980075-9e42-4143-bc44-32c72d60e84c tempest-VolumesExtendTest-611769720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.609s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:53 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-9b980075-9e42-4143-bc44-32c72d60e84c tempest-VolumesExtendTest-611769720 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:53 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-9b980075-9e42-4143-bc44-32c72d60e84c tempest-VolumesExtendTest-611769720 None] Deleted volume successfully. Feb 27 02:08:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9b980075-9e42-4143-bc44-32c72d60e84c tempest-VolumesExtendTest-611769720 None] Lock "cinder-59bda0a2-9d7e-44ec-87bb-de7da73626d6-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:54 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Flow 'volume_create_manager' (5b96d0c7-19ed-4f4f-a412-7f97abbb69dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71500a76-cf71-435f-a06a-34e2194a6bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71500a76-cf71-435f-a06a-34e2194a6bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1060503125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=218033f7-8181-46b1-9263-99e5a9421f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc14ce08a1cd4562bcaec15466b678ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:55Z,use_quota=True,user_id='778db24138f245b39c0766f78800e10d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39c6067-56bc-4eaa-b889-9c2a8f58457f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39c6067-56bc-4eaa-b889-9c2a8f58457f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83029b15-a9e9-41cb-8294-250c3108a0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83029b15-a9e9-41cb-8294-250c3108a0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '218033f7-8181-46b1-9263-99e5a9421f67', 'volume_name': 'volume-218033f7-8181-46b1-9263-99e5a9421f67', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4016aff6-63ec-425e-b910-c9405ba26594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4016aff6-63ec-425e-b910-c9405ba26594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7185f526-08c2-4784-b3a8-e35986809180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:55 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Volume 218033f7-8181-46b1-9263-99e5a9421f67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-218033f7-8181-46b1-9263-99e5a9421f67', 'volume_size': 1} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1060503125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=218033f7-8181-46b1-9263-99e5a9421f67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc14ce08a1cd4562bcaec15466b678ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:55Z,use_quota=True,user_id='778db24138f245b39c0766f78800e10d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Creating volume 218033f7-8181-46b1-9263-99e5a9421f67 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:55 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:55 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 1073741824 Feb 27 02:08:55 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:55 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 1073741824" returned: 0 in 0.769s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:55 devstack sudo[89071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 Feb 27 02:08:55 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:56 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67" returned: 0 in 0.588s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7185f526-08c2-4784-b3a8-e35986809180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-218033f7-8181-46b1-9263-99e5a9421f67', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9769cdeb-38e8-437d-993a-100855755ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:56 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Volume volume-218033f7-8181-46b1-9263-99e5a9421f67 (218033f7-8181-46b1-9263-99e5a9421f67): created successfully Feb 27 02:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9769cdeb-38e8-437d-993a-100855755ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Flow 'volume_create_manager' (5b96d0c7-19ed-4f4f-a412-7f97abbb69dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:56 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-19acfe59-3429-4355-aa08-f4aeeffa9342 tempest-SnapshotDependencyTests-953892319 None] Created volume successfully. Feb 27 02:08:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3899bf93-310f-4224-b945-ef5e27668898 tempest-SnapshotDependencyTests-953892319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3899bf93-310f-4224-b945-ef5e27668898 tempest-SnapshotDependencyTests-953892319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-3899bf93-310f-4224-b945-ef5e27668898 tempest-SnapshotDependencyTests-953892319 None] Creating offline snapshot 359b9579-5057-4864-acca-57673978f60b of volume 218033f7-8181-46b1-9263-99e5a9421f67 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:57 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78bfbd8-c200-4ac1-8992-f5d8fbf83f9c]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3899bf93-310f-4224-b945-ef5e27668898 tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:57 devstack sudo[89075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 Feb 27 02:08:57 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:57 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3899bf93-310f-4224-b945-ef5e27668898 tempest-SnapshotDependencyTests-953892319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67" returned: 0 in 0.582s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3899bf93-310f-4224-b945-ef5e27668898 tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:57 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b 1G Feb 27 02:08:57 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:58 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3899bf93-310f-4224-b945-ef5e27668898 tempest-SnapshotDependencyTests-953892319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b 1G" returned: 0 in 0.612s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3899bf93-310f-4224-b945-ef5e27668898 tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-218033f7-8181-46b1-9263-99e5a9421f67 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:58 devstack sudo[89086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-218033f7-8181-46b1-9263-99e5a9421f67 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b Feb 27 02:08:58 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:59 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3899bf93-310f-4224-b945-ef5e27668898 tempest-SnapshotDependencyTests-953892319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-218033f7-8181-46b1-9263-99e5a9421f67 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b" returned: 0 in 0.517s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:59 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-3899bf93-310f-4224-b945-ef5e27668898 tempest-SnapshotDependencyTests-953892319 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b is being set with open permissions: ugo+rw Feb 27 02:08:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3899bf93-310f-4224-b945-ef5e27668898 tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:59 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b Feb 27 02:08:59 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:59 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3899bf93-310f-4224-b945-ef5e27668898 tempest-SnapshotDependencyTests-953892319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b" returned: 0 in 0.819s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3899bf93-310f-4224-b945-ef5e27668898 tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:00 devstack sudo[89094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.info Feb 27 02:09:00 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:00 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3899bf93-310f-4224-b945-ef5e27668898 tempest-SnapshotDependencyTests-953892319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.info" returned: 0 in 1.008s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:00 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-3899bf93-310f-4224-b945-ef5e27668898 tempest-SnapshotDependencyTests-953892319 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.info is being set with open permissions: ugo+rw Feb 27 02:09:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3899bf93-310f-4224-b945-ef5e27668898 tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:01 devstack sudo[89097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.info Feb 27 02:09:01 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:01 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3899bf93-310f-4224-b945-ef5e27668898 tempest-SnapshotDependencyTests-953892319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.info" returned: 0 in 0.702s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3899bf93-310f-4224-b945-ef5e27668898 tempest-SnapshotDependencyTests-953892319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.356s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:01 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3899bf93-310f-4224-b945-ef5e27668898 tempest-SnapshotDependencyTests-953892319 None] Create snapshot completed successfully Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Flow 'volume_create_manager' (7853d5f2-4883-4730-8c1b-7c58ec4f27bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe3b37c-81d2-42f1-ac50-d39e7c8d4b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe3b37c-81d2-42f1-ac50-d39e7c8d4b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d609d1-4d70-41a1-919b-52648bc3b0b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc14ce08a1cd4562bcaec15466b678ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=359b9579-5057-4864-acca-57673978f60b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:03Z,use_quota=True,user_id='778db24138f245b39c0766f78800e10d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a96335-58ea-4b53-800c-3f9a9887a56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a96335-58ea-4b53-800c-3f9a9887a56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e40d97-8b3b-49c7-b0f6-6cc278cd744d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7e40d97-8b3b-49c7-b0f6-6cc278cd744d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '22d609d1-4d70-41a1-919b-52648bc3b0b3', 'volume_name': 'volume-22d609d1-4d70-41a1-919b-52648bc3b0b3', 'volume_size': 1, 'snapshot_id': '359b9579-5057-4864-acca-57673978f60b'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f13f6b0-decf-42e0-9d60-f438a46d38c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f13f6b0-decf-42e0-9d60-f438a46d38c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62757d23-3e46-4e15-a4e5-95093bda4a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:03 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Volume 22d609d1-4d70-41a1-919b-52648bc3b0b3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-22d609d1-4d70-41a1-919b-52648bc3b0b3', 'volume_size': 1, 'snapshot_id': '359b9579-5057-4864-acca-57673978f60b'} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Acquiring lock "cinder-quobyte-359b9579-5057-4864-acca-57673978f60b-22d609d1-4d70-41a1-919b-52648bc3b0b3" by "_create_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Lock "cinder-quobyte-359b9579-5057-4864-acca-57673978f60b-22d609d1-4d70-41a1-919b-52648bc3b0b3" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Creating volume 22d609d1-4d70-41a1-919b-52648bc3b0b3 from snapshot 359b9579-5057-4864-acca-57673978f60b {{(pid=83167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Acquiring lock "cinder-quobyte-22d609d1-4d70-41a1-919b-52648bc3b0b3" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Lock "cinder-quobyte-22d609d1-4d70-41a1-919b-52648bc3b0b3" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] snapshot: 359b9579-5057-4864-acca-57673978f60b, volume: 22d609d1-4d70-41a1-919b-52648bc3b0b3, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[133d0273-cf90-482b-bf36-027c0f841fc0]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:03 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b Feb 27 02:09:03 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:04 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b" returned: 0 in 0.898s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-218033f7-8181-46b1-9263-99e5a9421f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:09:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:09:04 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ba9985-8778-4f60-a29f-cb83cbf79ed8]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:04 devstack sudo[89107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 Feb 27 02:09:04 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:04 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Flow 'volume_create_manager' (619208d9-aa59-4bba-b5a2-d41fae4ecceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58800fd4-3d2d-4861-a5d6-eb121260f950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58800fd4-3d2d-4861-a5d6-eb121260f950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1083557829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a5036f-f4ea-4fcd-9b70-84976efe8738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89741beb30fc43d09440e82a478ac257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:05Z,use_quota=True,user_id='cc2b288c17b2464f8daf29e38078f270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809964d4-ba07-434a-b356-79d47ac72961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809964d4-ba07-434a-b356-79d47ac72961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99095e78-56b0-4a43-b310-5469fc2d9e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99095e78-56b0-4a43-b310-5469fc2d9e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67a5036f-f4ea-4fcd-9b70-84976efe8738', 'volume_name': 'volume-67a5036f-f4ea-4fcd-9b70-84976efe8738', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (773b555a-55cb-4bf0-b81b-8dd233f6b711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (773b555a-55cb-4bf0-b81b-8dd233f6b711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33fad0b3-105b-4078-966d-2e42e89ae3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:04 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Volume 67a5036f-f4ea-4fcd-9b70-84976efe8738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67a5036f-f4ea-4fcd-9b70-84976efe8738', 'volume_size': 1} Feb 27 02:09:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:05 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67" returned: 0 in 0.834s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:05 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Path /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-22d609d1-4d70-41a1-919b-52648bc3b0b3 not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:09:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-22d609d1-4d70-41a1-919b-52648bc3b0b3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:05 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-22d609d1-4d70-41a1-919b-52648bc3b0b3 Feb 27 02:09:05 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bfbdf460-db14-445a-ada5-b74c703dca1f tempest-VolumesNegativeTest-13968885 None] Acquiring lock "cinder-512fb587-cc9d-4922-acb2-6e099d00494e-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bfbdf460-db14-445a-ada5-b74c703dca1f tempest-VolumesNegativeTest-13968885 None] Lock "cinder-512fb587-cc9d-4922-acb2-6e099d00494e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bfbdf460-db14-445a-ada5-b74c703dca1f tempest-VolumesNegativeTest-13968885 None] Acquiring lock "cinder-quobyte-512fb587-cc9d-4922-acb2-6e099d00494e" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:07 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bfbdf460-db14-445a-ada5-b74c703dca1f tempest-VolumesNegativeTest-13968885 None] Lock "cinder-quobyte-512fb587-cc9d-4922-acb2-6e099d00494e" acquired by "delete_volume" :: waited 0.035s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:07 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb4042f-f494-452d-9e22-828471bd494c]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bfbdf460-db14-445a-ada5-b74c703dca1f tempest-VolumesNegativeTest-13968885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-512fb587-cc9d-4922-acb2-6e099d00494e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:07 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-512fb587-cc9d-4922-acb2-6e099d00494e Feb 27 02:09:07 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:08 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-22d609d1-4d70-41a1-919b-52648bc3b0b3" returned: 0 in 3.436s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:08 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ab7347-1429-4eb0-a62e-86ad8342270d]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:08 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:08 devstack sudo[89131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 Feb 27 02:09:08 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bfbdf460-db14-445a-ada5-b74c703dca1f tempest-VolumesNegativeTest-13968885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-512fb587-cc9d-4922-acb2-6e099d00494e" returned: 0 in 1.470s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bfbdf460-db14-445a-ada5-b74c703dca1f tempest-VolumesNegativeTest-13968885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-512fb587-cc9d-4922-acb2-6e099d00494e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:08 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-512fb587-cc9d-4922-acb2-6e099d00494e Feb 27 02:09:08 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:09 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bfbdf460-db14-445a-ada5-b74c703dca1f tempest-VolumesNegativeTest-13968885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-512fb587-cc9d-4922-acb2-6e099d00494e" returned: 0 in 0.611s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:09 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bfbdf460-db14-445a-ada5-b74c703dca1f tempest-VolumesNegativeTest-13968885 None] Lock "cinder-quobyte-512fb587-cc9d-4922-acb2-6e099d00494e" released by "delete_volume" :: held 2.150s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:09 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-bfbdf460-db14-445a-ada5-b74c703dca1f tempest-VolumesNegativeTest-13968885 None] Created reservations ['543d4775-e499-45f6-94ae-69452cde54f5', '73b6bd88-2d76-41ad-89c4-fe7e54fd5e8e', '30b092e8-1265-46de-99d3-8ee8ad0649f8', 'cfb5ec4b-0154-4974-b7f7-ffec14853e14'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bfbdf460-db14-445a-ada5-b74c703dca1f tempest-VolumesNegativeTest-13968885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bfbdf460-db14-445a-ada5-b74c703dca1f tempest-VolumesNegativeTest-13968885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bfbdf460-db14-445a-ada5-b74c703dca1f tempest-VolumesNegativeTest-13968885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bfbdf460-db14-445a-ada5-b74c703dca1f tempest-VolumesNegativeTest-13968885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bfbdf460-db14-445a-ada5-b74c703dca1f tempest-VolumesNegativeTest-13968885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bfbdf460-db14-445a-ada5-b74c703dca1f tempest-VolumesNegativeTest-13968885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:09 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67" returned: 0 in 0.869s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:09 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:09:09 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:09 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Image conversion details: src /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67, size 1024.00 MB, duration 3.44 sec, destination /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-22d609d1-4d70-41a1-919b-52648bc3b0b3 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:09:09 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Converted 1024.00 MB image at 297.86 MB/s Feb 27 02:09:09 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-22d609d1-4d70-41a1-919b-52648bc3b0b3 is being set with open permissions: ugo+rw Feb 27 02:09:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-22d609d1-4d70-41a1-919b-52648bc3b0b3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:09 devstack sudo[89141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-22d609d1-4d70-41a1-919b-52648bc3b0b3 Feb 27 02:09:09 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:10 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-22d609d1-4d70-41a1-919b-52648bc3b0b3" returned: 0 in 0.521s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Lock "cinder-quobyte-22d609d1-4d70-41a1-919b-52648bc3b0b3" released by "_copy_volume_from_snapshot" :: held 6.683s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Lock "cinder-quobyte-359b9579-5057-4864-acca-57673978f60b-22d609d1-4d70-41a1-919b-52648bc3b0b3" released by "_create_volume_from_snapshot" :: held 6.717s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.727s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.152s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:10 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1083557829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a5036f-f4ea-4fcd-9b70-84976efe8738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89741beb30fc43d09440e82a478ac257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:05Z,use_quota=True,user_id='cc2b288c17b2464f8daf29e38078f270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Creating volume 67a5036f-f4ea-4fcd-9b70-84976efe8738 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:10 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-67a5036f-f4ea-4fcd-9b70-84976efe8738 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bfbdf460-db14-445a-ada5-b74c703dca1f tempest-VolumesNegativeTest-13968885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.594s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-bfbdf460-db14-445a-ada5-b74c703dca1f tempest-VolumesNegativeTest-13968885 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:10 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-bfbdf460-db14-445a-ada5-b74c703dca1f tempest-VolumesNegativeTest-13968885 None] Deleted volume successfully. Feb 27 02:09:10 devstack sudo[89145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-67a5036f-f4ea-4fcd-9b70-84976efe8738 1073741824 Feb 27 02:09:10 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62757d23-3e46-4e15-a4e5-95093bda4a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d609d1-4d70-41a1-919b-52648bc3b0b3', 'volume_size': 1, 'snapshot_id': '359b9579-5057-4864-acca-57673978f60b'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5cff5d-30ad-4f7e-ad2d-fe2784b2f54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-bfbdf460-db14-445a-ada5-b74c703dca1f tempest-VolumesNegativeTest-13968885 None] Lock "cinder-512fb587-cc9d-4922-acb2-6e099d00494e-delete_volume" released by "delete_volume" :: held 2.996s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:10 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Volume volume-22d609d1-4d70-41a1-919b-52648bc3b0b3 (22d609d1-4d70-41a1-919b-52648bc3b0b3): created successfully Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5cff5d-30ad-4f7e-ad2d-fe2784b2f54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Flow 'volume_create_manager' (7853d5f2-4883-4730-8c1b-7c58ec4f27bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:10 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-74b05407-a294-429e-b721-87d8e9a4aba8 tempest-SnapshotDependencyTests-953892319 None] Created volume successfully. Feb 27 02:09:10 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-67a5036f-f4ea-4fcd-9b70-84976efe8738 1073741824" returned: 0 in 0.714s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-67a5036f-f4ea-4fcd-9b70-84976efe8738 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:10 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-67a5036f-f4ea-4fcd-9b70-84976efe8738 Feb 27 02:09:10 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] Acquiring lock "cinder-359b9579-5057-4864-acca-57673978f60b-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] Lock "cinder-359b9579-5057-4864-acca-57673978f60b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] Acquiring lock "cinder-quobyte-218033f7-8181-46b1-9263-99e5a9421f67" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] Lock "cinder-quobyte-218033f7-8181-46b1-9263-99e5a9421f67" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] Acquiring lock "cinder-quobyte-359b9579-5057-4864-acca-57673978f60b" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] Lock "cinder-quobyte-359b9579-5057-4864-acca-57673978f60b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] Deleting offline snapshot 359b9579-5057-4864-acca-57673978f60b of volume 218033f7-8181-46b1-9263-99e5a9421f67 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] snapshot_file for this snap is: volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b5ab3e-9e20-4bfb-beac-4aea0c7d72d2]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:11 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b Feb 27 02:09:11 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:11 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-67a5036f-f4ea-4fcd-9b70-84976efe8738" returned: 0 in 0.587s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33fad0b3-105b-4078-966d-2e42e89ae3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67a5036f-f4ea-4fcd-9b70-84976efe8738', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd89f0b-e7b4-46e8-9207-3d1e4c229520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:11 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Volume volume-67a5036f-f4ea-4fcd-9b70-84976efe8738 (67a5036f-f4ea-4fcd-9b70-84976efe8738): created successfully Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd89f0b-e7b4-46e8-9207-3d1e4c229520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Flow 'volume_create_manager' (619208d9-aa59-4bba-b5a2-d41fae4ecceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:11 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-392aa8d7-49d9-4bb0-8f16-06c5ff3e7f50 tempest-AbsoluteLimitsTests-330834217 None] Created volume successfully. Feb 27 02:09:11 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b" returned: 0 in 0.700s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-218033f7-8181-46b1-9263-99e5a9421f67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee395f04-136f-47d6-b288-09e3737a0e38]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:12 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 Feb 27 02:09:12 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:12 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67" returned: 0 in 0.791s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:12 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b Feb 27 02:09:12 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:12 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Flow 'volume_create_manager' (8b610fcf-187d-4bae-b626-c419437665e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6fd2e1-fbc1-47b6-81ad-3eec803c6f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-77c5aae9-a17b-44bb-a723-3341073c170f tempest-AbsoluteLimitsTests-330834217 None] Acquiring lock "cinder-67a5036f-f4ea-4fcd-9b70-84976efe8738-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Flow 'volume_create_manager' (bb6c03bc-0d98-4611-aa04-4840b883f29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a39800-f218-4b76-9998-214f0976ce3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6fd2e1-fbc1-47b6-81ad-3eec803c6f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1669216197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61bde64c-8d4a-4d0d-bf76-1d50cfc3e024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f397de34ce44aafb131beb1e88bf881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:13Z,use_quota=True,user_id='046bff95d9274844a3054350c567ef35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e27df21-f69a-4ca2-9f31-af8e0e715295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e27df21-f69a-4ca2-9f31-af8e0e715295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50cdde8-55b9-4d36-a397-5ec50937e1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50cdde8-55b9-4d36-a397-5ec50937e1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61bde64c-8d4a-4d0d-bf76-1d50cfc3e024', 'volume_name': 'volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29bb22a8-e05e-43a1-af3d-5958c07cdc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29bb22a8-e05e-43a1-af3d-5958c07cdc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca212ab-3e61-425d-a2fa-efd7656b272f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Volume 61bde64c-8d4a-4d0d-bf76-1d50cfc3e024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024', 'volume_size': 1} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1669216197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61bde64c-8d4a-4d0d-bf76-1d50cfc3e024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f397de34ce44aafb131beb1e88bf881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:13Z,use_quota=True,user_id='046bff95d9274844a3054350c567ef35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Creating volume 61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:13 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-77c5aae9-a17b-44bb-a723-3341073c170f tempest-AbsoluteLimitsTests-330834217 None] Lock "cinder-67a5036f-f4ea-4fcd-9b70-84976efe8738-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:13 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 1073741824 Feb 27 02:09:13 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a39800-f218-4b76-9998-214f0976ce3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-837940987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bf9c4a-0fad-4157-86e3-577aafe92c4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a4a9e1c5a54df790c5d1d965c2b141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:13Z,use_quota=True,user_id='e2924045897c4565be749d34f2f8bb04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af05cc05-1a4b-4e0c-9704-38e59927ca82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af05cc05-1a4b-4e0c-9704-38e59927ca82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a175f86-bcc4-4cb9-964e-dfab714addf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a175f86-bcc4-4cb9-964e-dfab714addf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59bf9c4a-0fad-4157-86e3-577aafe92c4e', 'volume_name': 'volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26cefa88-f3b4-4adf-8298-f61bcf9a6a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26cefa88-f3b4-4adf-8298-f61bcf9a6a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9100e6f-6c2e-4a37-bc98-a35caecc9a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:13 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Volume 59bf9c4a-0fad-4157-86e3-577aafe92c4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e', 'volume_size': 1} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-77c5aae9-a17b-44bb-a723-3341073c170f tempest-AbsoluteLimitsTests-330834217 None] Acquiring lock "cinder-quobyte-67a5036f-f4ea-4fcd-9b70-84976efe8738" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-77c5aae9-a17b-44bb-a723-3341073c170f tempest-AbsoluteLimitsTests-330834217 None] Lock "cinder-quobyte-67a5036f-f4ea-4fcd-9b70-84976efe8738" acquired by "delete_volume" :: waited 0.021s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[68aa1530-d47e-4804-9bbc-7274508a3a84]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-77c5aae9-a17b-44bb-a723-3341073c170f tempest-AbsoluteLimitsTests-330834217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-67a5036f-f4ea-4fcd-9b70-84976efe8738 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:13 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b" returned: 0 in 0.617s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:13 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b Feb 27 02:09:13 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:13 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-67a5036f-f4ea-4fcd-9b70-84976efe8738 Feb 27 02:09:13 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:13 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 1073741824" returned: 0 in 0.606s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:13 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 Feb 27 02:09:13 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:13 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-77c5aae9-a17b-44bb-a723-3341073c170f tempest-AbsoluteLimitsTests-330834217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-67a5036f-f4ea-4fcd-9b70-84976efe8738" returned: 0 in 0.538s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-77c5aae9-a17b-44bb-a723-3341073c170f tempest-AbsoluteLimitsTests-330834217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-67a5036f-f4ea-4fcd-9b70-84976efe8738 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:13 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-67a5036f-f4ea-4fcd-9b70-84976efe8738 Feb 27 02:09:13 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:13 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67.359b9579-5057-4864-acca-57673978f60b" returned: 0 in 0.501s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] Lock "cinder-quobyte-359b9579-5057-4864-acca-57673978f60b" released by "_delete_snapshot" :: held 2.689s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] Lock "cinder-quobyte-218033f7-8181-46b1-9263-99e5a9421f67" released by "delete_snapshot" :: held 2.713s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] Created reservations ['f8b37982-e688-4375-a33f-48df5b11007c', '65cb1a54-d428-459e-8258-c562a7e96599', '87844adf-c459-4bc8-9d73-4730d38077f7', '803bccc6-0fb9-4a93-a8ff-8b62656f2ea0'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:13 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] Delete snapshot completed successfully. Feb 27 02:09:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-36905798-163e-4baf-81cb-01354facd4fe tempest-SnapshotDependencyTests-953892319 None] Lock "cinder-359b9579-5057-4864-acca-57673978f60b-delete_snapshot" released by "delete_snapshot" :: held 2.844s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb79f880-b5af-47c0-b41e-31bea103a21b tempest-SnapshotDependencyTests-953892319 None] Acquiring lock "cinder-218033f7-8181-46b1-9263-99e5a9421f67-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb79f880-b5af-47c0-b41e-31bea103a21b tempest-SnapshotDependencyTests-953892319 None] Lock "cinder-218033f7-8181-46b1-9263-99e5a9421f67-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:14 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-77c5aae9-a17b-44bb-a723-3341073c170f tempest-AbsoluteLimitsTests-330834217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-67a5036f-f4ea-4fcd-9b70-84976efe8738" returned: 0 in 0.513s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-77c5aae9-a17b-44bb-a723-3341073c170f tempest-AbsoluteLimitsTests-330834217 None] Lock "cinder-quobyte-67a5036f-f4ea-4fcd-9b70-84976efe8738" released by "delete_volume" :: held 1.094s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb79f880-b5af-47c0-b41e-31bea103a21b tempest-SnapshotDependencyTests-953892319 None] Acquiring lock "cinder-quobyte-218033f7-8181-46b1-9263-99e5a9421f67" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:14 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024" returned: 0 in 0.612s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb79f880-b5af-47c0-b41e-31bea103a21b tempest-SnapshotDependencyTests-953892319 None] Lock "cinder-quobyte-218033f7-8181-46b1-9263-99e5a9421f67" acquired by "delete_volume" :: waited 0.023s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.222s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-837940987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59bf9c4a-0fad-4157-86e3-577aafe92c4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a4a9e1c5a54df790c5d1d965c2b141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:13Z,use_quota=True,user_id='e2924045897c4565be749d34f2f8bb04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Creating volume 59bf9c4a-0fad-4157-86e3-577aafe92c4e {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:14 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca212ab-3e61-425d-a2fa-efd7656b272f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ffd4a8-72f3-478d-b760-b352f86aa5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e 1073741824 Feb 27 02:09:14 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c27d02e-3af6-4b76-9cd2-ef2e316ba986]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb79f880-b5af-47c0-b41e-31bea103a21b tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:14 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Volume volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 (61bde64c-8d4a-4d0d-bf76-1d50cfc3e024): created successfully Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ffd4a8-72f3-478d-b760-b352f86aa5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Flow 'volume_create_manager' (8b610fcf-187d-4bae-b626-c419437665e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:14 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f0b549fd-5566-4d6f-8d12-a0e057600cb0 tempest-VolumesSnapshotListTestJSON-1520717000 None] Created volume successfully. Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-77c5aae9-a17b-44bb-a723-3341073c170f tempest-AbsoluteLimitsTests-330834217 None] Created reservations ['f2eaa530-ee04-4704-b5c8-2bf2f622ce0c', '59a9b8d8-163e-46c0-b314-2f29e794a02e', '26a5ce63-9bb1-4add-8d8d-320ac90c2291', '917b2f3f-d6d9-464c-ac94-1fa715dc7172'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:14 devstack sudo[89190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-77c5aae9-a17b-44bb-a723-3341073c170f tempest-AbsoluteLimitsTests-330834217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-77c5aae9-a17b-44bb-a723-3341073c170f tempest-AbsoluteLimitsTests-330834217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:14 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-77c5aae9-a17b-44bb-a723-3341073c170f tempest-AbsoluteLimitsTests-330834217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-77c5aae9-a17b-44bb-a723-3341073c170f tempest-AbsoluteLimitsTests-330834217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-77c5aae9-a17b-44bb-a723-3341073c170f tempest-AbsoluteLimitsTests-330834217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-77c5aae9-a17b-44bb-a723-3341073c170f tempest-AbsoluteLimitsTests-330834217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:14 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:09:14 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:14 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-77c5aae9-a17b-44bb-a723-3341073c170f tempest-AbsoluteLimitsTests-330834217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.445s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-77c5aae9-a17b-44bb-a723-3341073c170f tempest-AbsoluteLimitsTests-330834217 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:14 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-77c5aae9-a17b-44bb-a723-3341073c170f tempest-AbsoluteLimitsTests-330834217 None] Deleted volume successfully. Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-77c5aae9-a17b-44bb-a723-3341073c170f tempest-AbsoluteLimitsTests-330834217 None] Lock "cinder-67a5036f-f4ea-4fcd-9b70-84976efe8738-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:14 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e 1073741824" returned: 0 in 0.608s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:15 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb79f880-b5af-47c0-b41e-31bea103a21b tempest-SnapshotDependencyTests-953892319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67" returned: 0 in 0.624s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb79f880-b5af-47c0-b41e-31bea103a21b tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:15 devstack sudo[89203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e Feb 27 02:09:15 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:15 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67 Feb 27 02:09:15 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-190d9335-ec94-46fe-b3d7-cdd93ae8eb6d tempest-VolumesSnapshotListTestJSON-1520717000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:15 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-190d9335-ec94-46fe-b3d7-cdd93ae8eb6d tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.238s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9100e6f-6c2e-4a37-bc98-a35caecc9a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6985bd8d-00b9-43d9-ad64-8783202c3c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:15 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Volume volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e (59bf9c4a-0fad-4157-86e3-577aafe92c4e): created successfully Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6985bd8d-00b9-43d9-ad64-8783202c3c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Flow 'volume_create_manager' (bb6c03bc-0d98-4611-aa04-4840b883f29d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-190d9335-ec94-46fe-b3d7-cdd93ae8eb6d tempest-VolumesSnapshotListTestJSON-1520717000 None] Creating offline snapshot ba33b8a7-c432-47b7-8cb4-35f217af1463 of volume 61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:09:15 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-dbfa121d-679c-409e-85bd-c08e1802fbe1 tempest-VolumesSnapshotTestJSON-1899760600 None] Created volume successfully. Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f5cdf5-da39-4a04-afb4-33613e0697dc]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-190d9335-ec94-46fe-b3d7-cdd93ae8eb6d tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:15 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb79f880-b5af-47c0-b41e-31bea103a21b tempest-SnapshotDependencyTests-953892319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-218033f7-8181-46b1-9263-99e5a9421f67" returned: 0 in 0.621s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb79f880-b5af-47c0-b41e-31bea103a21b tempest-SnapshotDependencyTests-953892319 None] Lock "cinder-quobyte-218033f7-8181-46b1-9263-99e5a9421f67" released by "delete_volume" :: held 1.327s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-cb79f880-b5af-47c0-b41e-31bea103a21b tempest-SnapshotDependencyTests-953892319 None] Created reservations ['d63c5357-61e3-4d11-932d-0d2059385651', '5db3d503-130f-4be3-b48d-b413efff308c', '71179116-7031-46ff-984c-a2c9637cd202', 'd4447dae-92d3-42ef-875b-5c7013988847'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:15 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 Feb 27 02:09:15 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cb79f880-b5af-47c0-b41e-31bea103a21b tempest-SnapshotDependencyTests-953892319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cb79f880-b5af-47c0-b41e-31bea103a21b tempest-SnapshotDependencyTests-953892319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cb79f880-b5af-47c0-b41e-31bea103a21b tempest-SnapshotDependencyTests-953892319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-cb79f880-b5af-47c0-b41e-31bea103a21b tempest-SnapshotDependencyTests-953892319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cb79f880-b5af-47c0-b41e-31bea103a21b tempest-SnapshotDependencyTests-953892319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb79f880-b5af-47c0-b41e-31bea103a21b tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:15 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:09:15 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:16 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-190d9335-ec94-46fe-b3d7-cdd93ae8eb6d tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024" returned: 0 in 0.645s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-190d9335-ec94-46fe-b3d7-cdd93ae8eb6d tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:16 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 1G Feb 27 02:09:16 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:16 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cb79f880-b5af-47c0-b41e-31bea103a21b tempest-SnapshotDependencyTests-953892319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.634s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:16 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-cb79f880-b5af-47c0-b41e-31bea103a21b tempest-SnapshotDependencyTests-953892319 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:16 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-cb79f880-b5af-47c0-b41e-31bea103a21b tempest-SnapshotDependencyTests-953892319 None] Deleted volume successfully. Feb 27 02:09:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-cb79f880-b5af-47c0-b41e-31bea103a21b tempest-SnapshotDependencyTests-953892319 None] Lock "cinder-218033f7-8181-46b1-9263-99e5a9421f67-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-52fef452-bde6-4cde-a4d5-951e77643812 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-19fe3ae6-9d80-4020-821a-efda170066fc tempest-SnapshotDependencyTests-953892319 None] Acquiring lock "cinder-22d609d1-4d70-41a1-919b-52648bc3b0b3-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-19fe3ae6-9d80-4020-821a-efda170066fc tempest-SnapshotDependencyTests-953892319 None] Lock "cinder-22d609d1-4d70-41a1-919b-52648bc3b0b3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-19fe3ae6-9d80-4020-821a-efda170066fc tempest-SnapshotDependencyTests-953892319 None] Acquiring lock "cinder-quobyte-22d609d1-4d70-41a1-919b-52648bc3b0b3" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-19fe3ae6-9d80-4020-821a-efda170066fc tempest-SnapshotDependencyTests-953892319 None] Lock "cinder-quobyte-22d609d1-4d70-41a1-919b-52648bc3b0b3" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:16 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0329bf75-9605-421f-bb66-68b21da8c088]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19fe3ae6-9d80-4020-821a-efda170066fc tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-22d609d1-4d70-41a1-919b-52648bc3b0b3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:16 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-22d609d1-4d70-41a1-919b-52648bc3b0b3 Feb 27 02:09:16 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:17 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-190d9335-ec94-46fe-b3d7-cdd93ae8eb6d tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 1G" returned: 0 in 0.841s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-190d9335-ec94-46fe-b3d7-cdd93ae8eb6d tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:17 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 Feb 27 02:09:17 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:17 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19fe3ae6-9d80-4020-821a-efda170066fc tempest-SnapshotDependencyTests-953892319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-22d609d1-4d70-41a1-919b-52648bc3b0b3" returned: 0 in 0.644s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19fe3ae6-9d80-4020-821a-efda170066fc tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-22d609d1-4d70-41a1-919b-52648bc3b0b3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:17 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-22d609d1-4d70-41a1-919b-52648bc3b0b3 Feb 27 02:09:17 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:17 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-190d9335-ec94-46fe-b3d7-cdd93ae8eb6d tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463" returned: 0 in 0.766s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:17 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-190d9335-ec94-46fe-b3d7-cdd93ae8eb6d tempest-VolumesSnapshotListTestJSON-1520717000 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 is being set with open permissions: ugo+rw Feb 27 02:09:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-190d9335-ec94-46fe-b3d7-cdd93ae8eb6d tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:17 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 Feb 27 02:09:17 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:17 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19fe3ae6-9d80-4020-821a-efda170066fc tempest-SnapshotDependencyTests-953892319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-22d609d1-4d70-41a1-919b-52648bc3b0b3" returned: 0 in 0.705s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-19fe3ae6-9d80-4020-821a-efda170066fc tempest-SnapshotDependencyTests-953892319 None] Lock "cinder-quobyte-22d609d1-4d70-41a1-919b-52648bc3b0b3" released by "delete_volume" :: held 1.383s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:18 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-19fe3ae6-9d80-4020-821a-efda170066fc tempest-SnapshotDependencyTests-953892319 None] Created reservations ['841c0887-606f-490b-b63f-b4d4192e7e1f', '0a321996-abcf-459b-987b-f6d180827861', 'c4736ef5-e19d-46f3-a6d5-374a915d3f54', '82cf4e04-d8b8-4df6-b01d-2aefd29886ee'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-19fe3ae6-9d80-4020-821a-efda170066fc tempest-SnapshotDependencyTests-953892319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-19fe3ae6-9d80-4020-821a-efda170066fc tempest-SnapshotDependencyTests-953892319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-19fe3ae6-9d80-4020-821a-efda170066fc tempest-SnapshotDependencyTests-953892319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-19fe3ae6-9d80-4020-821a-efda170066fc tempest-SnapshotDependencyTests-953892319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-19fe3ae6-9d80-4020-821a-efda170066fc tempest-SnapshotDependencyTests-953892319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19fe3ae6-9d80-4020-821a-efda170066fc tempest-SnapshotDependencyTests-953892319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:18 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:09:18 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:18 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-190d9335-ec94-46fe-b3d7-cdd93ae8eb6d tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463" returned: 0 in 0.654s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-190d9335-ec94-46fe-b3d7-cdd93ae8eb6d tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:18 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.info Feb 27 02:09:18 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:18 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-19fe3ae6-9d80-4020-821a-efda170066fc tempest-SnapshotDependencyTests-953892319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.629s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:18 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-19fe3ae6-9d80-4020-821a-efda170066fc tempest-SnapshotDependencyTests-953892319 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:18 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-19fe3ae6-9d80-4020-821a-efda170066fc tempest-SnapshotDependencyTests-953892319 None] Deleted volume successfully. Feb 27 02:09:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-19fe3ae6-9d80-4020-821a-efda170066fc tempest-SnapshotDependencyTests-953892319 None] Lock "cinder-22d609d1-4d70-41a1-919b-52648bc3b0b3-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:19 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-190d9335-ec94-46fe-b3d7-cdd93ae8eb6d tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.info" returned: 0 in 0.464s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:19 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-190d9335-ec94-46fe-b3d7-cdd93ae8eb6d tempest-VolumesSnapshotListTestJSON-1520717000 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.info is being set with open permissions: ugo+rw Feb 27 02:09:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-190d9335-ec94-46fe-b3d7-cdd93ae8eb6d tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:19 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.info Feb 27 02:09:19 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Flow 'volume_create_manager' (7657ff6e-dab2-4ed2-b556-4ae96e4b62ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d3208f-0bca-434b-b245-6baa9e0b6e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d3208f-0bca-434b-b245-6baa9e0b6e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1527825806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896eef04-b73e-436a-92f8-3a22be1925ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef229986c1eb4fdf8638340d764bfab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:19Z,use_quota=True,user_id='03d4163d16c347019ba90a0766a09e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1583c70e-36e9-429b-bfc5-8cfe0a4e83a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1583c70e-36e9-429b-bfc5-8cfe0a4e83a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5474b623-5325-4777-9f1d-09b9a8770ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5474b623-5325-4777-9f1d-09b9a8770ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '896eef04-b73e-436a-92f8-3a22be1925ca', 'volume_name': 'volume-896eef04-b73e-436a-92f8-3a22be1925ca', 'volume_size': 2}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9d487b-2daa-4766-9247-d45ebdefcf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9d487b-2daa-4766-9247-d45ebdefcf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca5e7e75-90e4-4e30-be8b-2b376986f9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:19 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Volume 896eef04-b73e-436a-92f8-3a22be1925ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-896eef04-b73e-436a-92f8-3a22be1925ca', 'volume_size': 2} Feb 27 02:09:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:19 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-190d9335-ec94-46fe-b3d7-cdd93ae8eb6d tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.info" returned: 0 in 0.473s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-190d9335-ec94-46fe-b3d7-cdd93ae8eb6d tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.999s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-52fef452-bde6-4cde-a4d5-951e77643812 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.073s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:19 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-190d9335-ec94-46fe-b3d7-cdd93ae8eb6d tempest-VolumesSnapshotListTestJSON-1520717000 None] Create snapshot completed successfully Feb 27 02:09:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-52fef452-bde6-4cde-a4d5-951e77643812 tempest-VolumesSnapshotTestJSON-1899760600 None] Creating offline snapshot 507bfce3-1e0b-4d27-8edf-9f7b4f80be35 of volume 59bf9c4a-0fad-4157-86e3-577aafe92c4e {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:09:19 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9e78fe-7ced-4f52-a9ba-c0d6e48bbff7]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-52fef452-bde6-4cde-a4d5-951e77643812 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:19 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e Feb 27 02:09:19 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:20 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-52fef452-bde6-4cde-a4d5-951e77643812 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e" returned: 0 in 0.566s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-52fef452-bde6-4cde-a4d5-951e77643812 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.507bfce3-1e0b-4d27-8edf-9f7b4f80be35 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:20 devstack sudo[89254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.507bfce3-1e0b-4d27-8edf-9f7b4f80be35 1G Feb 27 02:09:20 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-05ac648e-803e-4f01-9c8b-6a0a67bb392d tempest-VolumesSnapshotListTestJSON-1520717000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:20 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-52fef452-bde6-4cde-a4d5-951e77643812 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.507bfce3-1e0b-4d27-8edf-9f7b4f80be35 1G" returned: 0 in 0.748s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-52fef452-bde6-4cde-a4d5-951e77643812 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.507bfce3-1e0b-4d27-8edf-9f7b4f80be35 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:20 devstack sudo[89260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.507bfce3-1e0b-4d27-8edf-9f7b4f80be35 Feb 27 02:09:20 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:21 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-52fef452-bde6-4cde-a4d5-951e77643812 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.507bfce3-1e0b-4d27-8edf-9f7b4f80be35" returned: 0 in 0.623s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:21 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-52fef452-bde6-4cde-a4d5-951e77643812 tempest-VolumesSnapshotTestJSON-1899760600 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.507bfce3-1e0b-4d27-8edf-9f7b4f80be35 is being set with open permissions: ugo+rw Feb 27 02:09:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-52fef452-bde6-4cde-a4d5-951e77643812 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.507bfce3-1e0b-4d27-8edf-9f7b4f80be35 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:21 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.507bfce3-1e0b-4d27-8edf-9f7b4f80be35 Feb 27 02:09:21 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:22 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-52fef452-bde6-4cde-a4d5-951e77643812 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.507bfce3-1e0b-4d27-8edf-9f7b4f80be35" returned: 0 in 0.450s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-52fef452-bde6-4cde-a4d5-951e77643812 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:22 devstack sudo[89269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.info Feb 27 02:09:22 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:22 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-52fef452-bde6-4cde-a4d5-951e77643812 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.info" returned: 0 in 0.417s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:22 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-52fef452-bde6-4cde-a4d5-951e77643812 tempest-VolumesSnapshotTestJSON-1899760600 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.info is being set with open permissions: ugo+rw Feb 27 02:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-52fef452-bde6-4cde-a4d5-951e77643812 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:22 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.info Feb 27 02:09:22 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:22 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-52fef452-bde6-4cde-a4d5-951e77643812 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.info" returned: 0 in 0.435s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-52fef452-bde6-4cde-a4d5-951e77643812 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.329s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.406s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1527825806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896eef04-b73e-436a-92f8-3a22be1925ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef229986c1eb4fdf8638340d764bfab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:19Z,use_quota=True,user_id='03d4163d16c347019ba90a0766a09e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Creating volume 896eef04-b73e-436a-92f8-3a22be1925ca {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:22 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:09:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-896eef04-b73e-436a-92f8-3a22be1925ca 2147483648 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:22 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-896eef04-b73e-436a-92f8-3a22be1925ca 2147483648 Feb 27 02:09:22 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:22 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-52fef452-bde6-4cde-a4d5-951e77643812 tempest-VolumesSnapshotTestJSON-1899760600 None] Create snapshot completed successfully Feb 27 02:09:23 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-896eef04-b73e-436a-92f8-3a22be1925ca 2147483648" returned: 0 in 0.660s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-896eef04-b73e-436a-92f8-3a22be1925ca {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:23 devstack sudo[89281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-896eef04-b73e-436a-92f8-3a22be1925ca Feb 27 02:09:23 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-507bfce3-1e0b-4d27-8edf-9f7b4f80be35-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-507bfce3-1e0b-4d27-8edf-9f7b4f80be35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-quobyte-59bf9c4a-0fad-4157-86e3-577aafe92c4e" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-59bf9c4a-0fad-4157-86e3-577aafe92c4e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-quobyte-507bfce3-1e0b-4d27-8edf-9f7b4f80be35" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-507bfce3-1e0b-4d27-8edf-9f7b4f80be35" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] Deleting offline snapshot 507bfce3-1e0b-4d27-8edf-9f7b4f80be35 of volume 59bf9c4a-0fad-4157-86e3-577aafe92c4e {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] snapshot_file for this snap is: volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.507bfce3-1e0b-4d27-8edf-9f7b4f80be35 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d76d434-367c-4719-a867-a5b3630c41c1]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.507bfce3-1e0b-4d27-8edf-9f7b4f80be35 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:24 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.507bfce3-1e0b-4d27-8edf-9f7b4f80be35 Feb 27 02:09:24 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:24 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-896eef04-b73e-436a-92f8-3a22be1925ca" returned: 0 in 0.540s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-05ac648e-803e-4f01-9c8b-6a0a67bb392d tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.443s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca5e7e75-90e4-4e30-be8b-2b376986f9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-896eef04-b73e-436a-92f8-3a22be1925ca', 'volume_size': 2}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9fd6fd-82be-4398-8ffc-bc2134e7675a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-05ac648e-803e-4f01-9c8b-6a0a67bb392d tempest-VolumesSnapshotListTestJSON-1520717000 None] Creating offline snapshot c6e9bfa1-def2-4b2a-9649-523f81904a07 of volume 61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:09:24 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Volume volume-896eef04-b73e-436a-92f8-3a22be1925ca (896eef04-b73e-436a-92f8-3a22be1925ca): created successfully Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9fd6fd-82be-4398-8ffc-bc2134e7675a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Flow 'volume_create_manager' (7657ff6e-dab2-4ed2-b556-4ae96e4b62ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc7b52e-5584-4090-9bb1-5d25647fb2db]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-05ac648e-803e-4f01-9c8b-6a0a67bb392d tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:24 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3ff1452a-a886-42e5-b8fb-5f502e7e8e73 tempest-VolumesCloneNegativeTest-2002703454 None] Created volume successfully. Feb 27 02:09:24 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 Feb 27 02:09:24 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:24 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.507bfce3-1e0b-4d27-8edf-9f7b4f80be35" returned: 0 in 0.611s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2a8a09-e6d6-4228-a708-e832d3d854b7]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:24 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e Feb 27 02:09:24 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:24 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-05ac648e-803e-4f01-9c8b-6a0a67bb392d tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463" returned: 0 in 0.747s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-05ac648e-803e-4f01-9c8b-6a0a67bb392d tempest-VolumesSnapshotListTestJSON-1520717000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-05ac648e-803e-4f01-9c8b-6a0a67bb392d tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:24 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 1G Feb 27 02:09:25 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98fff369-a992-4ad1-a4ca-5a2f4f19549c tempest-VolumesCloneNegativeTest-2002703454 None] Acquiring lock "cinder-896eef04-b73e-436a-92f8-3a22be1925ca-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98fff369-a992-4ad1-a4ca-5a2f4f19549c tempest-VolumesCloneNegativeTest-2002703454 None] Lock "cinder-896eef04-b73e-436a-92f8-3a22be1925ca-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98fff369-a992-4ad1-a4ca-5a2f4f19549c tempest-VolumesCloneNegativeTest-2002703454 None] Acquiring lock "cinder-quobyte-896eef04-b73e-436a-92f8-3a22be1925ca" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98fff369-a992-4ad1-a4ca-5a2f4f19549c tempest-VolumesCloneNegativeTest-2002703454 None] Lock "cinder-quobyte-896eef04-b73e-436a-92f8-3a22be1925ca" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:25 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a569a884-86aa-4437-b4fc-858ea1348a28]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98fff369-a992-4ad1-a4ca-5a2f4f19549c tempest-VolumesCloneNegativeTest-2002703454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-896eef04-b73e-436a-92f8-3a22be1925ca {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:25 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-896eef04-b73e-436a-92f8-3a22be1925ca Feb 27 02:09:25 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:25 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e" returned: 0 in 0.707s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.507bfce3-1e0b-4d27-8edf-9f7b4f80be35 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:25 devstack sudo[89304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.507bfce3-1e0b-4d27-8edf-9f7b4f80be35 Feb 27 02:09:25 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:25 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-05ac648e-803e-4f01-9c8b-6a0a67bb392d tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 1G" returned: 0 in 0.751s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-05ac648e-803e-4f01-9c8b-6a0a67bb392d tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:25 devstack sudo[89312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 Feb 27 02:09:25 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:25 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98fff369-a992-4ad1-a4ca-5a2f4f19549c tempest-VolumesCloneNegativeTest-2002703454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-896eef04-b73e-436a-92f8-3a22be1925ca" returned: 0 in 0.638s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98fff369-a992-4ad1-a4ca-5a2f4f19549c tempest-VolumesCloneNegativeTest-2002703454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-896eef04-b73e-436a-92f8-3a22be1925ca {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:25 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-896eef04-b73e-436a-92f8-3a22be1925ca Feb 27 02:09:25 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:25 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.507bfce3-1e0b-4d27-8edf-9f7b4f80be35" returned: 0 in 0.529s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.507bfce3-1e0b-4d27-8edf-9f7b4f80be35 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:25 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.507bfce3-1e0b-4d27-8edf-9f7b4f80be35 Feb 27 02:09:25 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:26 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98fff369-a992-4ad1-a4ca-5a2f4f19549c tempest-VolumesCloneNegativeTest-2002703454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-896eef04-b73e-436a-92f8-3a22be1925ca" returned: 0 in 0.548s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98fff369-a992-4ad1-a4ca-5a2f4f19549c tempest-VolumesCloneNegativeTest-2002703454 None] Lock "cinder-quobyte-896eef04-b73e-436a-92f8-3a22be1925ca" released by "delete_volume" :: held 1.218s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:26 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-98fff369-a992-4ad1-a4ca-5a2f4f19549c tempest-VolumesCloneNegativeTest-2002703454 None] Created reservations ['8c9a2b3f-1045-4a80-b85b-4dffaa717d32', 'a7bb68db-9eed-4fc7-9bf4-6a5fed18294c', '030878d1-b19c-4c46-b5f2-970e5e6de4ea', '20a9d273-5a7f-4d86-a008-a6854e529347'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-98fff369-a992-4ad1-a4ca-5a2f4f19549c tempest-VolumesCloneNegativeTest-2002703454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-98fff369-a992-4ad1-a4ca-5a2f4f19549c tempest-VolumesCloneNegativeTest-2002703454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-98fff369-a992-4ad1-a4ca-5a2f4f19549c tempest-VolumesCloneNegativeTest-2002703454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-98fff369-a992-4ad1-a4ca-5a2f4f19549c tempest-VolumesCloneNegativeTest-2002703454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-98fff369-a992-4ad1-a4ca-5a2f4f19549c tempest-VolumesCloneNegativeTest-2002703454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98fff369-a992-4ad1-a4ca-5a2f4f19549c tempest-VolumesCloneNegativeTest-2002703454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:26 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e.507bfce3-1e0b-4d27-8edf-9f7b4f80be35" returned: 0 in 0.554s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:26 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:26 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:09:26 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-05ac648e-803e-4f01-9c8b-6a0a67bb392d tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07" returned: 0 in 0.779s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:26 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-05ac648e-803e-4f01-9c8b-6a0a67bb392d tempest-VolumesSnapshotListTestJSON-1520717000 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 is being set with open permissions: ugo+rw Feb 27 02:09:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-05ac648e-803e-4f01-9c8b-6a0a67bb392d tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-507bfce3-1e0b-4d27-8edf-9f7b4f80be35" released by "_delete_snapshot" :: held 2.499s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-59bf9c4a-0fad-4157-86e3-577aafe92c4e" released by "delete_snapshot" :: held 2.515s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:26 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 Feb 27 02:09:26 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:26 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] Created reservations ['99264691-3407-4f47-8e2f-29dd81371e60', 'e67d4faa-e2e8-4798-85ba-974b77f87a93', 'dca2973d-bff7-4644-937c-ec4ac97c6de0', '3a27b515-299a-4a5d-adb7-15645c168273'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:26 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] Delete snapshot completed successfully. Feb 27 02:09:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5ac25679-fa28-47eb-ace9-81e1e2fccef2 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-507bfce3-1e0b-4d27-8edf-9f7b4f80be35-delete_snapshot" released by "delete_snapshot" :: held 2.657s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:26 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-98fff369-a992-4ad1-a4ca-5a2f4f19549c tempest-VolumesCloneNegativeTest-2002703454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.490s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:26 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-98fff369-a992-4ad1-a4ca-5a2f4f19549c tempest-VolumesCloneNegativeTest-2002703454 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:26 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-98fff369-a992-4ad1-a4ca-5a2f4f19549c tempest-VolumesCloneNegativeTest-2002703454 None] Deleted volume successfully. Feb 27 02:09:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-98fff369-a992-4ad1-a4ca-5a2f4f19549c tempest-VolumesCloneNegativeTest-2002703454 None] Lock "cinder-896eef04-b73e-436a-92f8-3a22be1925ca-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:27 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-05ac648e-803e-4f01-9c8b-6a0a67bb392d tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07" returned: 0 in 0.591s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-05ac648e-803e-4f01-9c8b-6a0a67bb392d tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.946s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:27 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-05ac648e-803e-4f01-9c8b-6a0a67bb392d tempest-VolumesSnapshotListTestJSON-1520717000 None] Create snapshot completed successfully Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Flow 'volume_create_manager' (0a4dd095-e112-4daf-a372-c88f00008ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33709afa-ac36-45e5-8740-0864b48411b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33709afa-ac36-45e5-8740-0864b48411b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1867196947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ec1c3e-528a-4017-b10a-f966378bd238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a4a9e1c5a54df790c5d1d965c2b141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:27Z,use_quota=True,user_id='e2924045897c4565be749d34f2f8bb04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46411d10-ce42-4cae-9d3d-51d84d799ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46411d10-ce42-4cae-9d3d-51d84d799ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65b1208-fc25-4b3c-9dd8-f0016b6bc50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65b1208-fc25-4b3c-9dd8-f0016b6bc50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ec1c3e-528a-4017-b10a-f966378bd238', 'volume_name': 'volume-97ec1c3e-528a-4017-b10a-f966378bd238', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (502c1110-1735-4eda-8455-9d05f0fd30be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (502c1110-1735-4eda-8455-9d05f0fd30be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb5e255-b19a-4e20-b371-0ab3b08c1d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:27 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Volume 97ec1c3e-528a-4017-b10a-f966378bd238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ec1c3e-528a-4017-b10a-f966378bd238', 'volume_size': 1} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1867196947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ec1c3e-528a-4017-b10a-f966378bd238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a4a9e1c5a54df790c5d1d965c2b141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:27Z,use_quota=True,user_id='e2924045897c4565be749d34f2f8bb04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Creating volume 97ec1c3e-528a-4017-b10a-f966378bd238 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:27 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:09:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:27 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 1073741824 Feb 27 02:09:27 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3dae81ca-8b2f-430c-8c57-85115847b964 tempest-VolumesSnapshotListTestJSON-1520717000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:28 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 1073741824" returned: 0 in 0.585s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:28 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 Feb 27 02:09:28 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:28 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238" returned: 0 in 0.462s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3dae81ca-8b2f-430c-8c57-85115847b964 tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.510s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-3dae81ca-8b2f-430c-8c57-85115847b964 tempest-VolumesSnapshotListTestJSON-1520717000 None] Creating offline snapshot d03ca547-08d6-47c3-b8f7-c39e35d42331 of volume 61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:09:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb5e255-b19a-4e20-b371-0ab3b08c1d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ec1c3e-528a-4017-b10a-f966378bd238', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23edce25-34b7-4c34-ad04-f2bb20e242eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:28 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee1cabf-ce9c-4aaa-b47f-cd17cd1b9b84]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3dae81ca-8b2f-430c-8c57-85115847b964 tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:28 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Volume volume-97ec1c3e-528a-4017-b10a-f966378bd238 (97ec1c3e-528a-4017-b10a-f966378bd238): created successfully Feb 27 02:09:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23edce25-34b7-4c34-ad04-f2bb20e242eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Flow 'volume_create_manager' (0a4dd095-e112-4daf-a372-c88f00008ba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:28 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-73fb7fea-6bee-48ee-ac90-03a048c21ee0 tempest-VolumesSnapshotTestJSON-1899760600 None] Created volume successfully. Feb 27 02:09:28 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 Feb 27 02:09:28 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:29 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Flow 'volume_create_manager' (049e18c2-aacd-461d-93a0-1f3f9f7341e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2393ee-8ae2-44ce-879b-1af8e769d4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:29 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c2393ee-8ae2-44ce-879b-1af8e769d4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-412349412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2b88cd334c184fe4840951b76f36dfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:29Z,use_quota=True,user_id='983ac70ab90f4b01b9765356a9588944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a70d5f-4481-4b18-bd04-5cd0d2d928ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a70d5f-4481-4b18-bd04-5cd0d2d928ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703677a2-342b-4352-942c-c00a41be27a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703677a2-342b-4352-942c-c00a41be27a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1', 'volume_name': 'volume-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b16d527-5415-4195-bb90-6c4006d468f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b16d527-5415-4195-bb90-6c4006d468f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045600df-0f7c-4edf-9304-149b750f7e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:29 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Volume 3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1', 'volume_size': 1} Feb 27 02:09:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3dae81ca-8b2f-430c-8c57-85115847b964 tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07" returned: 0 in 0.597s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-3dae81ca-8b2f-430c-8c57-85115847b964 tempest-VolumesSnapshotListTestJSON-1520717000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3dae81ca-8b2f-430c-8c57-85115847b964 tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.d03ca547-08d6-47c3-b8f7-c39e35d42331 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:29 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.d03ca547-08d6-47c3-b8f7-c39e35d42331 1G Feb 27 02:09:29 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5f4cefb9-e29b-4d1f-9831-1d547da6d7a1 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:29 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3dae81ca-8b2f-430c-8c57-85115847b964 tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.d03ca547-08d6-47c3-b8f7-c39e35d42331 1G" returned: 0 in 0.558s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3dae81ca-8b2f-430c-8c57-85115847b964 tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.d03ca547-08d6-47c3-b8f7-c39e35d42331 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:29 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.d03ca547-08d6-47c3-b8f7-c39e35d42331 Feb 27 02:09:29 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:30 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3dae81ca-8b2f-430c-8c57-85115847b964 tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.d03ca547-08d6-47c3-b8f7-c39e35d42331" returned: 0 in 0.443s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:30 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-3dae81ca-8b2f-430c-8c57-85115847b964 tempest-VolumesSnapshotListTestJSON-1520717000 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.d03ca547-08d6-47c3-b8f7-c39e35d42331 is being set with open permissions: ugo+rw Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3dae81ca-8b2f-430c-8c57-85115847b964 tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.d03ca547-08d6-47c3-b8f7-c39e35d42331 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:30 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.d03ca547-08d6-47c3-b8f7-c39e35d42331 Feb 27 02:09:30 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:30 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3dae81ca-8b2f-430c-8c57-85115847b964 tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.d03ca547-08d6-47c3-b8f7-c39e35d42331" returned: 0 in 0.398s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3dae81ca-8b2f-430c-8c57-85115847b964 tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.079s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.431s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-412349412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2b88cd334c184fe4840951b76f36dfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:29Z,use_quota=True,user_id='983ac70ab90f4b01b9765356a9588944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Creating volume 3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:30 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:30 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1 1073741824 Feb 27 02:09:30 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:30 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3dae81ca-8b2f-430c-8c57-85115847b964 tempest-VolumesSnapshotListTestJSON-1520717000 None] Create snapshot completed successfully Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:30 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:09:30 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:31 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1 1073741824" returned: 0 in 0.498s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:31 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1 Feb 27 02:09:31 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:31 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.478s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:31 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1" returned: 0 in 0.460s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5f4cefb9-e29b-4d1f-9831-1d547da6d7a1 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.058s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-5f4cefb9-e29b-4d1f-9831-1d547da6d7a1 tempest-VolumesSnapshotTestJSON-1899760600 None] Creating offline snapshot e0f9c379-013b-4810-a687-06cb811dff5b of volume 97ec1c3e-528a-4017-b10a-f966378bd238 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045600df-0f7c-4edf-9304-149b750f7e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d314b34-cb67-48d2-945b-fa495a45c075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd29406-8e90-4c15-9c0a-08226a1057a6]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f4cefb9-e29b-4d1f-9831-1d547da6d7a1 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:31 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Volume volume-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1 (3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1): created successfully Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d314b34-cb67-48d2-945b-fa495a45c075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Flow 'volume_create_manager' (049e18c2-aacd-461d-93a0-1f3f9f7341e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:31 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-78b83983-feb1-41ae-9048-d97766eb2ed7 tempest-VolumesGetTest-224619659 None] Created volume successfully. Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] Acquiring lock "cinder-d03ca547-08d6-47c3-b8f7-c39e35d42331-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-d03ca547-08d6-47c3-b8f7-c39e35d42331-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] Acquiring lock "cinder-quobyte-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-quobyte-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] Acquiring lock "cinder-quobyte-d03ca547-08d6-47c3-b8f7-c39e35d42331" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-quobyte-d03ca547-08d6-47c3-b8f7-c39e35d42331" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] Deleting offline snapshot d03ca547-08d6-47c3-b8f7-c39e35d42331 of volume 61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] snapshot_file for this snap is: volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.d03ca547-08d6-47c3-b8f7-c39e35d42331 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17e7f93-e494-45f0-8f84-1c6984ecda83]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.d03ca547-08d6-47c3-b8f7-c39e35d42331 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:31 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 Feb 27 02:09:31 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:31 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.d03ca547-08d6-47c3-b8f7-c39e35d42331 Feb 27 02:09:31 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:32 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f4cefb9-e29b-4d1f-9831-1d547da6d7a1 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238" returned: 0 in 0.505s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f4cefb9-e29b-4d1f-9831-1d547da6d7a1 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:32 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b 1G Feb 27 02:09:32 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:32 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.d03ca547-08d6-47c3-b8f7-c39e35d42331" returned: 0 in 0.500s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:32 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[102bfef7-a8c6-42de-81c6-304df41ba0ac]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:32 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 Feb 27 02:09:32 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:32 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:32 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07" returned: 0 in 0.515s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.d03ca547-08d6-47c3-b8f7-c39e35d42331 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f4cefb9-e29b-4d1f-9831-1d547da6d7a1 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b 1G" returned: 0 in 0.636s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f4cefb9-e29b-4d1f-9831-1d547da6d7a1 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ec1c3e-528a-4017-b10a-f966378bd238 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:32 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.d03ca547-08d6-47c3-b8f7-c39e35d42331 Feb 27 02:09:32 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:32 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ec1c3e-528a-4017-b10a-f966378bd238 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b Feb 27 02:09:32 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Flow 'volume_create_manager' (44e1f503-1dbd-47a8-a707-539ef629dc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aaf1f5b-4f1e-4fb0-b7b5-ef916ba139cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aaf1f5b-4f1e-4fb0-b7b5-ef916ba139cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1639936641',display_name='tempest-VolumesGetTest-Volume-2026946253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ddba8b-4bbb-44a3-bd8c-693854b2b59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b88cd334c184fe4840951b76f36dfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:33Z,use_quota=True,user_id='983ac70ab90f4b01b9765356a9588944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6108fd-13a1-4c7e-8f03-f64c1a0c1bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6108fd-13a1-4c7e-8f03-f64c1a0c1bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a64f43-03b5-41f4-bbbb-44b9cf89c74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a64f43-03b5-41f4-bbbb-44b9cf89c74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ddba8b-4bbb-44a3-bd8c-693854b2b59b', 'volume_name': 'volume-70ddba8b-4bbb-44a3-bd8c-693854b2b59b', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f253d2-38cf-4eea-b864-61955f3e6fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f253d2-38cf-4eea-b864-61955f3e6fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b337b15d-92c3-4bb3-b2c4-baac070c0516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:33 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Volume 70ddba8b-4bbb-44a3-bd8c-693854b2b59b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ddba8b-4bbb-44a3-bd8c-693854b2b59b', 'volume_size': 1} Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:33 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f4cefb9-e29b-4d1f-9831-1d547da6d7a1 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97ec1c3e-528a-4017-b10a-f966378bd238 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b" returned: 0 in 0.486s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:33 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-5f4cefb9-e29b-4d1f-9831-1d547da6d7a1 tempest-VolumesSnapshotTestJSON-1899760600 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b is being set with open permissions: ugo+rw Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f4cefb9-e29b-4d1f-9831-1d547da6d7a1 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:33 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b Feb 27 02:09:33 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:33 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.d03ca547-08d6-47c3-b8f7-c39e35d42331" returned: 0 in 0.545s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.d03ca547-08d6-47c3-b8f7-c39e35d42331 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:33 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.d03ca547-08d6-47c3-b8f7-c39e35d42331 Feb 27 02:09:33 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:33 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f4cefb9-e29b-4d1f-9831-1d547da6d7a1 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b" returned: 0 in 0.408s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f4cefb9-e29b-4d1f-9831-1d547da6d7a1 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:33 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.info Feb 27 02:09:33 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:33 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.d03ca547-08d6-47c3-b8f7-c39e35d42331" returned: 0 in 0.452s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-quobyte-d03ca547-08d6-47c3-b8f7-c39e35d42331" released by "_delete_snapshot" :: held 2.068s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-quobyte-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024" released by "delete_snapshot" :: held 2.083s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:34 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] Created reservations ['c6a7f42d-ab85-4e21-96b0-d75afb629774', 'f231409e-274a-4898-acb5-6445361ad67a', '80768091-110f-4987-ae35-110a93d0b7ed', '632baedc-cd6c-4163-b37c-f91ee3a37d4e'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:34 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] Delete snapshot completed successfully. Feb 27 02:09:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e7fff1d3-ff82-4d21-8dc4-9d9a7a48029d tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-d03ca547-08d6-47c3-b8f7-c39e35d42331-delete_snapshot" released by "delete_snapshot" :: held 2.163s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:34 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f4cefb9-e29b-4d1f-9831-1d547da6d7a1 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.info" returned: 0 in 0.433s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:34 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-5f4cefb9-e29b-4d1f-9831-1d547da6d7a1 tempest-VolumesSnapshotTestJSON-1899760600 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.info is being set with open permissions: ugo+rw Feb 27 02:09:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f4cefb9-e29b-4d1f-9831-1d547da6d7a1 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:34 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.info Feb 27 02:09:34 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:34 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f4cefb9-e29b-4d1f-9831-1d547da6d7a1 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.info" returned: 0 in 0.428s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5f4cefb9-e29b-4d1f-9831-1d547da6d7a1 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.967s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.503s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1639936641',display_name='tempest-VolumesGetTest-Volume-2026946253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ddba8b-4bbb-44a3-bd8c-693854b2b59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b88cd334c184fe4840951b76f36dfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:33Z,use_quota=True,user_id='983ac70ab90f4b01b9765356a9588944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Creating volume 70ddba8b-4bbb-44a3-bd8c-693854b2b59b {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:34 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:09:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-70ddba8b-4bbb-44a3-bd8c-693854b2b59b 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:34 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-5f4cefb9-e29b-4d1f-9831-1d547da6d7a1 tempest-VolumesSnapshotTestJSON-1899760600 None] Create snapshot completed successfully Feb 27 02:09:34 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-70ddba8b-4bbb-44a3-bd8c-693854b2b59b 1073741824 Feb 27 02:09:34 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] Acquiring lock "cinder-c6e9bfa1-def2-4b2a-9649-523f81904a07-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-c6e9bfa1-def2-4b2a-9649-523f81904a07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] Acquiring lock "cinder-quobyte-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-quobyte-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] Acquiring lock "cinder-quobyte-c6e9bfa1-def2-4b2a-9649-523f81904a07" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-quobyte-c6e9bfa1-def2-4b2a-9649-523f81904a07" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] Deleting offline snapshot c6e9bfa1-def2-4b2a-9649-523f81904a07 of volume 61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] snapshot_file for this snap is: volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4132c19-6aa3-4337-aec5-98871df4fa0d]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:35 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 Feb 27 02:09:35 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Flow 'volume_create_manager' (04f57880-3a4b-4b65-ad1b-92d64f3acbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e0199a-5c5d-4d06-96f0-4ce3a49c6e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e0199a-5c5d-4d06-96f0-4ce3a49c6e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1909854958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eb0be08-51ab-4e14-9100-ecb4c71f8b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a4a9e1c5a54df790c5d1d965c2b141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e0f9c379-013b-4810-a687-06cb811dff5b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:35Z,use_quota=True,user_id='e2924045897c4565be749d34f2f8bb04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51b1ab3-fe96-454a-9612-451aac3eff77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51b1ab3-fe96-454a-9612-451aac3eff77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6784ecf9-2b07-4bab-b781-80a2c0bf6584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6784ecf9-2b07-4bab-b781-80a2c0bf6584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0eb0be08-51ab-4e14-9100-ecb4c71f8b87', 'volume_name': 'volume-0eb0be08-51ab-4e14-9100-ecb4c71f8b87', 'volume_size': 2, 'snapshot_id': 'e0f9c379-013b-4810-a687-06cb811dff5b'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211e9476-24c1-4a11-8dfe-bb58d734b95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211e9476-24c1-4a11-8dfe-bb58d734b95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ff01e7-49e8-4af4-b6c1-7a302d62bd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:35 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Volume 0eb0be08-51ab-4e14-9100-ecb4c71f8b87: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0eb0be08-51ab-4e14-9100-ecb4c71f8b87', 'volume_size': 2, 'snapshot_id': 'e0f9c379-013b-4810-a687-06cb811dff5b'} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:35 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-70ddba8b-4bbb-44a3-bd8c-693854b2b59b 1073741824" returned: 0 in 0.647s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-70ddba8b-4bbb-44a3-bd8c-693854b2b59b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:35 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-70ddba8b-4bbb-44a3-bd8c-693854b2b59b Feb 27 02:09:35 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:35 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07" returned: 0 in 0.561s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc80e16-56c5-42a1-b431-d50f39eb0449]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:35 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 Feb 27 02:09:35 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:35 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-70ddba8b-4bbb-44a3-bd8c-693854b2b59b" returned: 0 in 0.463s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.514s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-quobyte-e0f9c379-013b-4810-a687-06cb811dff5b-0eb0be08-51ab-4e14-9100-ecb4c71f8b87" by "_create_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b337b15d-92c3-4bb3-b2c4-baac070c0516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ddba8b-4bbb-44a3-bd8c-693854b2b59b', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2dae945-b9c6-4e49-b841-82c7d6291396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-e0f9c379-013b-4810-a687-06cb811dff5b-0eb0be08-51ab-4e14-9100-ecb4c71f8b87" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Creating volume 0eb0be08-51ab-4e14-9100-ecb4c71f8b87 from snapshot e0f9c379-013b-4810-a687-06cb811dff5b {{(pid=83167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-quobyte-0eb0be08-51ab-4e14-9100-ecb4c71f8b87" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-0eb0be08-51ab-4e14-9100-ecb4c71f8b87" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] snapshot: e0f9c379-013b-4810-a687-06cb811dff5b, volume: 0eb0be08-51ab-4e14-9100-ecb4c71f8b87, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:09:35 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Volume volume-70ddba8b-4bbb-44a3-bd8c-693854b2b59b (70ddba8b-4bbb-44a3-bd8c-693854b2b59b): created successfully Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2dae945-b9c6-4e49-b841-82c7d6291396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Flow 'volume_create_manager' (44e1f503-1dbd-47a8-a707-539ef629dc9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:35 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a4154e37-6adb-4b8b-aea9-2219682d96ed tempest-VolumesGetTest-224619659 None] Created volume successfully. Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[787e5883-d2c4-41d8-b7db-d7608838460a]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:36 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b Feb 27 02:09:36 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:36 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463" returned: 0 in 0.531s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:36 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 Feb 27 02:09:36 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ec034697-afbe-4c1e-a784-b91a38a8fea5 tempest-VolumesGetTest-224619659 None] Acquiring lock "cinder-70ddba8b-4bbb-44a3-bd8c-693854b2b59b-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ec034697-afbe-4c1e-a784-b91a38a8fea5 tempest-VolumesGetTest-224619659 None] Lock "cinder-70ddba8b-4bbb-44a3-bd8c-693854b2b59b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ec034697-afbe-4c1e-a784-b91a38a8fea5 tempest-VolumesGetTest-224619659 None] Acquiring lock "cinder-quobyte-70ddba8b-4bbb-44a3-bd8c-693854b2b59b" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:36 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ec034697-afbe-4c1e-a784-b91a38a8fea5 tempest-VolumesGetTest-224619659 None] Lock "cinder-quobyte-70ddba8b-4bbb-44a3-bd8c-693854b2b59b" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:36 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b" returned: 0 in 0.601s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ec1c3e-528a-4017-b10a-f966378bd238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:09:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:09:36 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e51045-17f3-4bdc-b822-ebf4911c6d21]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ec034697-afbe-4c1e-a784-b91a38a8fea5 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-70ddba8b-4bbb-44a3-bd8c-693854b2b59b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:36 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf1c080-bd8b-47ee-822c-31981b0265be]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:36 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-70ddba8b-4bbb-44a3-bd8c-693854b2b59b Feb 27 02:09:36 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:36 devstack sudo[89479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 Feb 27 02:09:36 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:36 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07" returned: 0 in 0.649s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:36 devstack sudo[89485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07 Feb 27 02:09:36 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:37 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238" returned: 0 in 0.515s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:37 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Path /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0eb0be08-51ab-4e14-9100-ecb4c71f8b87 not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:09:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0eb0be08-51ab-4e14-9100-ecb4c71f8b87 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:37 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0eb0be08-51ab-4e14-9100-ecb4c71f8b87 Feb 27 02:09:37 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:37 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ec034697-afbe-4c1e-a784-b91a38a8fea5 tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-70ddba8b-4bbb-44a3-bd8c-693854b2b59b" returned: 0 in 0.564s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ec034697-afbe-4c1e-a784-b91a38a8fea5 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-70ddba8b-4bbb-44a3-bd8c-693854b2b59b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:37 devstack sudo[89495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-70ddba8b-4bbb-44a3-bd8c-693854b2b59b Feb 27 02:09:37 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:37 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.c6e9bfa1-def2-4b2a-9649-523f81904a07" returned: 0 in 0.483s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-quobyte-c6e9bfa1-def2-4b2a-9649-523f81904a07" released by "_delete_snapshot" :: held 2.278s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-quobyte-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024" released by "delete_snapshot" :: held 2.293s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:37 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] Created reservations ['d3a41f14-05e7-481d-9941-45c4411d44df', '2168dec3-79dd-4fef-ac03-1a5e7af29899', 'cc9feb8f-1a82-4fef-9ec5-f31510f9f132', '07ba3aa0-957c-48b3-bd47-6e39fef0311c'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:37 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] Delete snapshot completed successfully. Feb 27 02:09:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-87df5f2f-4f71-4f2d-95fe-a0571fa9744e tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-c6e9bfa1-def2-4b2a-9649-523f81904a07-delete_snapshot" released by "delete_snapshot" :: held 2.409s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:37 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ec034697-afbe-4c1e-a784-b91a38a8fea5 tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-70ddba8b-4bbb-44a3-bd8c-693854b2b59b" returned: 0 in 0.462s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ec034697-afbe-4c1e-a784-b91a38a8fea5 tempest-VolumesGetTest-224619659 None] Lock "cinder-quobyte-70ddba8b-4bbb-44a3-bd8c-693854b2b59b" released by "delete_volume" :: held 1.057s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:37 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ec034697-afbe-4c1e-a784-b91a38a8fea5 tempest-VolumesGetTest-224619659 None] Created reservations ['6aed5a49-9f14-46e3-973a-7ee8b3805eb5', '7a6e29c9-0099-4071-85cd-bbcd55f693d5', 'f2669c9f-c707-4e22-8057-2c77855d9312', '14d4ceb4-1671-4f2a-8945-5801a2950572'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ec034697-afbe-4c1e-a784-b91a38a8fea5 tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ec034697-afbe-4c1e-a784-b91a38a8fea5 tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ec034697-afbe-4c1e-a784-b91a38a8fea5 tempest-VolumesGetTest-224619659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ec034697-afbe-4c1e-a784-b91a38a8fea5 tempest-VolumesGetTest-224619659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ec034697-afbe-4c1e-a784-b91a38a8fea5 tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ec034697-afbe-4c1e-a784-b91a38a8fea5 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:37 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:09:37 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] Acquiring lock "cinder-ba33b8a7-c432-47b7-8cb4-35f217af1463-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-ba33b8a7-c432-47b7-8cb4-35f217af1463-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] Acquiring lock "cinder-quobyte-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-quobyte-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] Acquiring lock "cinder-quobyte-ba33b8a7-c432-47b7-8cb4-35f217af1463" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-quobyte-ba33b8a7-c432-47b7-8cb4-35f217af1463" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] Deleting offline snapshot ba33b8a7-c432-47b7-8cb4-35f217af1463 of volume 61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:09:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] snapshot_file for this snap is: volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:09:38 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8a1d3e-c45b-4e90-8f6e-92f92ca93435]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:38 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 Feb 27 02:09:38 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c3650f1c-ddbb-4f24-ab52-47bd9fff0bb7 tempest-VolumesGetTest-224619659 None] Acquiring lock "cinder-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c3650f1c-ddbb-4f24-ab52-47bd9fff0bb7 tempest-VolumesGetTest-224619659 None] Lock "cinder-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:39 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ec034697-afbe-4c1e-a784-b91a38a8fea5 tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 1.586s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:39 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-ec034697-afbe-4c1e-a784-b91a38a8fea5 tempest-VolumesGetTest-224619659 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:39 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ec034697-afbe-4c1e-a784-b91a38a8fea5 tempest-VolumesGetTest-224619659 None] Deleted volume successfully. Feb 27 02:09:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c3650f1c-ddbb-4f24-ab52-47bd9fff0bb7 tempest-VolumesGetTest-224619659 None] Acquiring lock "cinder-quobyte-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ec034697-afbe-4c1e-a784-b91a38a8fea5 tempest-VolumesGetTest-224619659 None] Lock "cinder-70ddba8b-4bbb-44a3-bd8c-693854b2b59b-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c3650f1c-ddbb-4f24-ab52-47bd9fff0bb7 tempest-VolumesGetTest-224619659 None] Lock "cinder-quobyte-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1" acquired by "delete_volume" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:39 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5ba1fd-a23b-42b1-840f-0ef6907102a6]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c3650f1c-ddbb-4f24-ab52-47bd9fff0bb7 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:39 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0eb0be08-51ab-4e14-9100-ecb4c71f8b87" returned: 0 in 2.532s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:39 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ea66cc-2e03-447e-9cd8-7c125a3e4da1]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:39 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1 Feb 27 02:09:39 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:39 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:39 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 Feb 27 02:09:39 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463" returned: 0 in 1.360s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:39 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e6849c-2727-4bbf-8cfd-cc7257cd8fb5]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:39 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 Feb 27 02:09:39 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:40 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:40 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c3650f1c-ddbb-4f24-ab52-47bd9fff0bb7 tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1" returned: 0 in 0.721s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c3650f1c-ddbb-4f24-ab52-47bd9fff0bb7 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238" returned: 0 in 0.628s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Image conversion details: src /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238, size 1024.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0eb0be08-51ab-4e14-9100-ecb4c71f8b87 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:09:40 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Converted 1024.00 MB image at 404.18 MB/s Feb 27 02:09:40 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0eb0be08-51ab-4e14-9100-ecb4c71f8b87 is being set with open permissions: ugo+rw Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0eb0be08-51ab-4e14-9100-ecb4c71f8b87 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:40 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1 Feb 27 02:09:40 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:40 devstack sudo[89534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0eb0be08-51ab-4e14-9100-ecb4c71f8b87 Feb 27 02:09:40 devstack sudo[89534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:40 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024" returned: 0 in 0.604s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:40 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 Feb 27 02:09:40 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:40 devstack sudo[89534]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0eb0be08-51ab-4e14-9100-ecb4c71f8b87" returned: 0 in 0.419s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-0eb0be08-51ab-4e14-9100-ecb4c71f8b87" released by "_copy_volume_from_snapshot" :: held 4.793s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-e0f9c379-013b-4810-a687-06cb811dff5b-0eb0be08-51ab-4e14-9100-ecb4c71f8b87" released by "_create_volume_from_snapshot" :: held 4.818s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.842s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ff01e7-49e8-4af4-b6c1-7a302d62bd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eb0be08-51ab-4e14-9100-ecb4c71f8b87', 'volume_size': 2, 'snapshot_id': 'e0f9c379-013b-4810-a687-06cb811dff5b'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3899c9-6c55-49ec-8e20-ec74f6662e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:40 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c3650f1c-ddbb-4f24-ab52-47bd9fff0bb7 tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1" returned: 0 in 0.490s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c3650f1c-ddbb-4f24-ab52-47bd9fff0bb7 tempest-VolumesGetTest-224619659 None] Lock "cinder-quobyte-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1" released by "delete_volume" :: held 1.256s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:40 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Volume volume-0eb0be08-51ab-4e14-9100-ecb4c71f8b87 (0eb0be08-51ab-4e14-9100-ecb4c71f8b87): created successfully Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3899c9-6c55-49ec-8e20-ec74f6662e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Flow 'volume_create_manager' (04f57880-3a4b-4b65-ad1b-92d64f3acbc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-c3650f1c-ddbb-4f24-ab52-47bd9fff0bb7 tempest-VolumesGetTest-224619659 None] Created reservations ['89371a74-72ce-498a-808b-5cabcdad24ab', '8a455e6d-e5b0-4262-99c1-ebc178b0e08d', '63e7d1a5-0f31-4712-a288-487e1932db69', '802b915e-8904-4d7b-b615-c35e58d0307a'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:40 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-16b2ce64-3dbb-4dcc-8b91-d8419ce02897 tempest-VolumesSnapshotTestJSON-1899760600 None] Created volume successfully. Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c3650f1c-ddbb-4f24-ab52-47bd9fff0bb7 tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c3650f1c-ddbb-4f24-ab52-47bd9fff0bb7 tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c3650f1c-ddbb-4f24-ab52-47bd9fff0bb7 tempest-VolumesGetTest-224619659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c3650f1c-ddbb-4f24-ab52-47bd9fff0bb7 tempest-VolumesGetTest-224619659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c3650f1c-ddbb-4f24-ab52-47bd9fff0bb7 tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c3650f1c-ddbb-4f24-ab52-47bd9fff0bb7 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:40 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:09:40 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:40 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463" returned: 0 in 0.542s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:40 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463 Feb 27 02:09:40 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:41 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c3650f1c-ddbb-4f24-ab52-47bd9fff0bb7 tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.493s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:41 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-c3650f1c-ddbb-4f24-ab52-47bd9fff0bb7 tempest-VolumesGetTest-224619659 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:41 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c3650f1c-ddbb-4f24-ab52-47bd9fff0bb7 tempest-VolumesGetTest-224619659 None] Deleted volume successfully. Feb 27 02:09:41 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c3650f1c-ddbb-4f24-ab52-47bd9fff0bb7 tempest-VolumesGetTest-224619659 None] Lock "cinder-3bf9b46c-b56b-49fd-93dc-b5a2aef21cc1-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:41 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024.ba33b8a7-c432-47b7-8cb4-35f217af1463" returned: 0 in 0.516s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:41 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-quobyte-ba33b8a7-c432-47b7-8cb4-35f217af1463" released by "_delete_snapshot" :: held 3.131s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:41 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-quobyte-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024" released by "delete_snapshot" :: held 3.154s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:41 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] Created reservations ['4ee90471-66d5-4608-b0aa-4e2543c1b96e', '2b478d45-9e4c-4572-b8fc-ae40da2266af', 'dea43650-e10a-4953-a525-7c81aabe65b2', 'e51c88b5-3523-495d-846d-471fb56a980c'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:41 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] Delete snapshot completed successfully. Feb 27 02:09:41 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3dd6fe57-6cca-40e1-ad26-4634da14d95f tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-ba33b8a7-c432-47b7-8cb4-35f217af1463-delete_snapshot" released by "delete_snapshot" :: held 3.312s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:41 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c18ae8a7-1c43-4f55-aebe-cd339f52eed9 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-0eb0be08-51ab-4e14-9100-ecb4c71f8b87-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:41 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c18ae8a7-1c43-4f55-aebe-cd339f52eed9 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-0eb0be08-51ab-4e14-9100-ecb4c71f8b87-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:41 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Flow 'volume_create_manager' (a76b968d-b51f-4ed6-b67f-4afd01df278b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a135a898-e954-4475-a228-b10ee32e67e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a135a898-e954-4475-a228-b10ee32e67e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1388738468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc87d310-76f7-4314-9126-255849853efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b88cd334c184fe4840951b76f36dfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:42Z,use_quota=True,user_id='983ac70ab90f4b01b9765356a9588944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d35f97b-64bb-47f5-a5a9-0c407fe27688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d35f97b-64bb-47f5-a5a9-0c407fe27688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b1d69a-df7d-471c-9575-9d46a2856a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b1d69a-df7d-471c-9575-9d46a2856a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc87d310-76f7-4314-9126-255849853efe', 'volume_name': 'volume-dc87d310-76f7-4314-9126-255849853efe', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (870734b5-94cd-4244-8953-ff4d1058f39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (870734b5-94cd-4244-8953-ff4d1058f39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b992a7-ebfb-4c79-9605-69c5d875fd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:42 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Volume dc87d310-76f7-4314-9126-255849853efe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc87d310-76f7-4314-9126-255849853efe', 'volume_size': 1} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1388738468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc87d310-76f7-4314-9126-255849853efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b88cd334c184fe4840951b76f36dfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:42Z,use_quota=True,user_id='983ac70ab90f4b01b9765356a9588944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Creating volume dc87d310-76f7-4314-9126-255849853efe {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:42 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:42 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe 1073741824 Feb 27 02:09:42 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c18ae8a7-1c43-4f55-aebe-cd339f52eed9 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-quobyte-0eb0be08-51ab-4e14-9100-ecb4c71f8b87" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c18ae8a7-1c43-4f55-aebe-cd339f52eed9 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-0eb0be08-51ab-4e14-9100-ecb4c71f8b87" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f3615e-990b-4fca-88a2-1f30bd72e2da]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c18ae8a7-1c43-4f55-aebe-cd339f52eed9 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0eb0be08-51ab-4e14-9100-ecb4c71f8b87 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:42 devstack sudo[89552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0eb0be08-51ab-4e14-9100-ecb4c71f8b87 Feb 27 02:09:42 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:42 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe 1073741824" returned: 0 in 0.582s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:42 devstack sudo[89560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe Feb 27 02:09:42 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:42 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c18ae8a7-1c43-4f55-aebe-cd339f52eed9 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0eb0be08-51ab-4e14-9100-ecb4c71f8b87" returned: 0 in 0.601s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c18ae8a7-1c43-4f55-aebe-cd339f52eed9 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0eb0be08-51ab-4e14-9100-ecb4c71f8b87 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3e56401d-08e6-4e8d-849d-a6770da9cfbe tempest-VolumesSnapshotListTestJSON-1520717000 None] Acquiring lock "cinder-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3e56401d-08e6-4e8d-849d-a6770da9cfbe tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:42 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0eb0be08-51ab-4e14-9100-ecb4c71f8b87 Feb 27 02:09:42 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3e56401d-08e6-4e8d-849d-a6770da9cfbe tempest-VolumesSnapshotListTestJSON-1520717000 None] Acquiring lock "cinder-quobyte-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3e56401d-08e6-4e8d-849d-a6770da9cfbe tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-quobyte-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a87f927-7b4e-4bec-b180-eb2a88da7f37]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3e56401d-08e6-4e8d-849d-a6770da9cfbe tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:42 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 Feb 27 02:09:42 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:43 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c18ae8a7-1c43-4f55-aebe-cd339f52eed9 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0eb0be08-51ab-4e14-9100-ecb4c71f8b87" returned: 0 in 0.445s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c18ae8a7-1c43-4f55-aebe-cd339f52eed9 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-0eb0be08-51ab-4e14-9100-ecb4c71f8b87" released by "delete_volume" :: held 1.071s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-c18ae8a7-1c43-4f55-aebe-cd339f52eed9 tempest-VolumesSnapshotTestJSON-1899760600 None] Created reservations ['0022324e-02a6-43c2-aa1d-4c991b7a3b86', '39ebd786-2952-4367-ad39-7c5dfe59ef3c', 'cb63ddc6-16ce-44bc-8d75-89aca03d7f4a', '78a15686-c80e-4515-84c6-9b7ab9073b9b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:43 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe" returned: 0 in 0.563s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b992a7-ebfb-4c79-9605-69c5d875fd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc87d310-76f7-4314-9126-255849853efe', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3bf609-2d1e-467e-aebf-d0d1fa4f477b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:43 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Volume volume-dc87d310-76f7-4314-9126-255849853efe (dc87d310-76f7-4314-9126-255849853efe): created successfully Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3bf609-2d1e-467e-aebf-d0d1fa4f477b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Flow 'volume_create_manager' (a76b968d-b51f-4ed6-b67f-4afd01df278b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:43 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1c96ea6e-168d-4a66-b43e-b6d8776cc156 tempest-VolumesGetTest-224619659 None] Created volume successfully. Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c18ae8a7-1c43-4f55-aebe-cd339f52eed9 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c18ae8a7-1c43-4f55-aebe-cd339f52eed9 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c18ae8a7-1c43-4f55-aebe-cd339f52eed9 tempest-VolumesSnapshotTestJSON-1899760600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:43 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c18ae8a7-1c43-4f55-aebe-cd339f52eed9 tempest-VolumesSnapshotTestJSON-1899760600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c18ae8a7-1c43-4f55-aebe-cd339f52eed9 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c18ae8a7-1c43-4f55-aebe-cd339f52eed9 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3e56401d-08e6-4e8d-849d-a6770da9cfbe tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024" returned: 0 in 0.513s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3e56401d-08e6-4e8d-849d-a6770da9cfbe tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:43 devstack sudo[89571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:09:43 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:43 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024 Feb 27 02:09:43 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:43 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3e56401d-08e6-4e8d-849d-a6770da9cfbe tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024" returned: 0 in 0.403s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3e56401d-08e6-4e8d-849d-a6770da9cfbe tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-quobyte-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024" released by "delete_volume" :: held 0.950s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:43 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c18ae8a7-1c43-4f55-aebe-cd339f52eed9 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.443s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-c18ae8a7-1c43-4f55-aebe-cd339f52eed9 tempest-VolumesSnapshotTestJSON-1899760600 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:43 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c18ae8a7-1c43-4f55-aebe-cd339f52eed9 tempest-VolumesSnapshotTestJSON-1899760600 None] Deleted volume successfully. Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c18ae8a7-1c43-4f55-aebe-cd339f52eed9 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-0eb0be08-51ab-4e14-9100-ecb4c71f8b87-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-3e56401d-08e6-4e8d-849d-a6770da9cfbe tempest-VolumesSnapshotListTestJSON-1520717000 None] Created reservations ['76eddc1d-c0a2-44ce-bf95-630a7c08e44b', '90d17e47-eb8c-4f94-a207-8b39422c3451', 'dae79297-b7e7-4138-bc23-28a34218cbb7', '0d5f32bf-e855-454a-8c30-b38d302c7174'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3e56401d-08e6-4e8d-849d-a6770da9cfbe tempest-VolumesSnapshotListTestJSON-1520717000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3e56401d-08e6-4e8d-849d-a6770da9cfbe tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3e56401d-08e6-4e8d-849d-a6770da9cfbe tempest-VolumesSnapshotListTestJSON-1520717000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3e56401d-08e6-4e8d-849d-a6770da9cfbe tempest-VolumesSnapshotListTestJSON-1520717000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3e56401d-08e6-4e8d-849d-a6770da9cfbe tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3e56401d-08e6-4e8d-849d-a6770da9cfbe tempest-VolumesSnapshotListTestJSON-1520717000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:43 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:09:43 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-e0f9c379-013b-4810-a687-06cb811dff5b-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-e0f9c379-013b-4810-a687-06cb811dff5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-quobyte-97ec1c3e-528a-4017-b10a-f966378bd238" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-97ec1c3e-528a-4017-b10a-f966378bd238" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-quobyte-e0f9c379-013b-4810-a687-06cb811dff5b" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-e0f9c379-013b-4810-a687-06cb811dff5b" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] Deleting offline snapshot e0f9c379-013b-4810-a687-06cb811dff5b of volume 97ec1c3e-528a-4017-b10a-f966378bd238 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] snapshot_file for this snap is: volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8655ba85-11e4-456f-a05a-c4292f14d460]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:44 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b Feb 27 02:09:44 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Flow 'volume_create_manager' (cd33143e-0826-48b7-a540-9d560de397db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:44 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d9c52f-898a-40f3-b0e0-5861353321ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3e56401d-08e6-4e8d-849d-a6770da9cfbe tempest-VolumesSnapshotListTestJSON-1520717000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.547s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-3e56401d-08e6-4e8d-849d-a6770da9cfbe tempest-VolumesSnapshotListTestJSON-1520717000 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:44 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3e56401d-08e6-4e8d-849d-a6770da9cfbe tempest-VolumesSnapshotListTestJSON-1520717000 None] Deleted volume successfully. Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d9c52f-898a-40f3-b0e0-5861353321ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1079537905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646cc51b-c29b-411e-a1d1-1745ab9ab823,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2b88cd334c184fe4840951b76f36dfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=dc87d310-76f7-4314-9126-255849853efe,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:44Z,use_quota=True,user_id='983ac70ab90f4b01b9765356a9588944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6401ac0d-1f89-4981-bb8b-808f80c61bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6401ac0d-1f89-4981-bb8b-808f80c61bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82db301-3303-4f81-8061-7b322a0597b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82db301-3303-4f81-8061-7b322a0597b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '646cc51b-c29b-411e-a1d1-1745ab9ab823', 'volume_name': 'volume-646cc51b-c29b-411e-a1d1-1745ab9ab823', 'volume_size': 1, 'source_volid': 'dc87d310-76f7-4314-9126-255849853efe', 'source_volstatus': 'available'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (996ff5a9-a2f8-4266-a6bc-e9351a9e4907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (996ff5a9-a2f8-4266-a6bc-e9351a9e4907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4134189-6922-4abe-a9a7-bca352b17fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Volume 646cc51b-c29b-411e-a1d1-1745ab9ab823: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-646cc51b-c29b-411e-a1d1-1745ab9ab823', 'volume_size': 1, 'source_volid': 'dc87d310-76f7-4314-9126-255849853efe', 'source_volstatus': 'available'} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3e56401d-08e6-4e8d-849d-a6770da9cfbe tempest-VolumesSnapshotListTestJSON-1520717000 None] Lock "cinder-61bde64c-8d4a-4d0d-bf76-1d50cfc3e024-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:44 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Cloning volume dc87d310-76f7-4314-9126-255849853efe to volume 646cc51b-c29b-411e-a1d1-1745ab9ab823 Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Creating offline snapshot 7432bca3-d404-4d40-90e0-f5a7ffc2407d of volume dc87d310-76f7-4314-9126-255849853efe {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a621e966-8e55-44cb-8fdf-9ab4c8b4cc1b]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:44 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe Feb 27 02:09:44 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:44 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97ec1c3e-528a-4017-b10a-f966378bd238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f0e3c4-ac04-48d1-a4c1-a7f0b07721d6]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:44 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 Feb 27 02:09:44 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:45 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe" returned: 0 in 0.579s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:45 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d 1G Feb 27 02:09:45 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:45 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238" returned: 0 in 0.589s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:45 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b Feb 27 02:09:45 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:45 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d 1G" returned: 0 in 0.645s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc87d310-76f7-4314-9126-255849853efe -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:45 devstack sudo[89602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc87d310-76f7-4314-9126-255849853efe -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d Feb 27 02:09:45 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:46 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b" returned: 0 in 0.679s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:46 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b Feb 27 02:09:46 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:46 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc87d310-76f7-4314-9126-255849853efe -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d" returned: 0 in 0.643s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:46 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d is being set with open permissions: ugo+rw Feb 27 02:09:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:46 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d Feb 27 02:09:46 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:46 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238.e0f9c379-013b-4810-a687-06cb811dff5b" returned: 0 in 0.606s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-e0f9c379-013b-4810-a687-06cb811dff5b" released by "_delete_snapshot" :: held 2.480s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-97ec1c3e-528a-4017-b10a-f966378bd238" released by "delete_snapshot" :: held 2.496s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:46 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] Created reservations ['68da4290-3835-40ba-a7f0-1bbea70d45fb', '8fc89751-e872-4cdf-91c8-4e24b619e66b', '7a6d5945-8b9c-4255-9741-779c54e244b8', '4326c452-6218-429f-a9ef-a48e7380683f'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:46 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] Delete snapshot completed successfully. Feb 27 02:09:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7297fdd6-c9c4-48a1-aeae-c17cc0627cdd tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-e0f9c379-013b-4810-a687-06cb811dff5b-delete_snapshot" released by "delete_snapshot" :: held 2.656s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:46 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d" returned: 0 in 0.543s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:46 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.info Feb 27 02:09:46 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Flow 'volume_create_manager' (02ac9d98-1651-4450-a418-f3e1f43ff6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2202b5b-6db5-4f43-bf03-15340f0af827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2202b5b-6db5-4f43-bf03-15340f0af827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1795311359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f066d5d3-b0ae-4613-8697-1c89292d1e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de08bd54d0144fd4ba9b9ff17c150c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:47Z,use_quota=True,user_id='db9ab1af218041ae9ae7d4290a6ab28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24bcc965-ac74-46c2-9769-00949eed50e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24bcc965-ac74-46c2-9769-00949eed50e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac740d84-d2d3-4d28-9f73-135a175e34d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac740d84-d2d3-4d28-9f73-135a175e34d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f066d5d3-b0ae-4613-8697-1c89292d1e9d', 'volume_name': 'volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d', 'volume_size': 2}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129443d5-dd65-4146-81ea-6b01ed43a3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129443d5-dd65-4146-81ea-6b01ed43a3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87ec866-0023-46f4-9c4f-f0b1cb619dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:47 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Volume f066d5d3-b0ae-4613-8697-1c89292d1e9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d', 'volume_size': 2} Feb 27 02:09:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-aeef2604-a321-43f5-ab68-05504629e8e2 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-97ec1c3e-528a-4017-b10a-f966378bd238-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-aeef2604-a321-43f5-ab68-05504629e8e2 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-97ec1c3e-528a-4017-b10a-f966378bd238-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-aeef2604-a321-43f5-ab68-05504629e8e2 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-quobyte-97ec1c3e-528a-4017-b10a-f966378bd238" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-aeef2604-a321-43f5-ab68-05504629e8e2 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-97ec1c3e-528a-4017-b10a-f966378bd238" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:47 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ab357d-65f5-4182-8f46-cb0f4dac24fd]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aeef2604-a321-43f5-ab68-05504629e8e2 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:47 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.info" returned: 0 in 0.644s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:47 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.info is being set with open permissions: ugo+rw Feb 27 02:09:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:47 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.info Feb 27 02:09:47 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:47 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 Feb 27 02:09:47 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:48 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.info" returned: 0 in 0.457s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:48 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Acquiring lock "cinder-quobyte-646cc51b-c29b-411e-a1d1-1745ab9ab823" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aeef2604-a321-43f5-ab68-05504629e8e2 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238" returned: 0 in 0.522s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aeef2604-a321-43f5-ab68-05504629e8e2 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Lock "cinder-quobyte-646cc51b-c29b-411e-a1d1-1745ab9ab823" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] snapshot: 7432bca3-d404-4d40-90e0-f5a7ffc2407d, volume: 646cc51b-c29b-411e-a1d1-1745ab9ab823, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:09:48 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238 Feb 27 02:09:48 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a06140-0ab1-407c-9a58-28123613d8bb]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:48 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d Feb 27 02:09:48 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:48 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aeef2604-a321-43f5-ab68-05504629e8e2 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-97ec1c3e-528a-4017-b10a-f966378bd238" returned: 0 in 0.478s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-aeef2604-a321-43f5-ab68-05504629e8e2 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-97ec1c3e-528a-4017-b10a-f966378bd238" released by "delete_volume" :: held 1.031s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-aeef2604-a321-43f5-ab68-05504629e8e2 tempest-VolumesSnapshotTestJSON-1899760600 None] Created reservations ['2df41c61-0d69-4f1c-b17e-bdc602067e09', 'a8f6fc28-d59f-4f46-8699-b6b88b1ba125', '9a4cf659-b548-46f6-b802-8c1019c8bf44', '99047582-0f57-4c24-9c7d-21d3743a6d0d'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:48 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d" returned: 0 in 0.516s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc87d310-76f7-4314-9126-255849853efe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aeef2604-a321-43f5-ab68-05504629e8e2 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aeef2604-a321-43f5-ab68-05504629e8e2 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-aeef2604-a321-43f5-ab68-05504629e8e2 tempest-VolumesSnapshotTestJSON-1899760600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-aeef2604-a321-43f5-ab68-05504629e8e2 tempest-VolumesSnapshotTestJSON-1899760600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-aeef2604-a321-43f5-ab68-05504629e8e2 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aeef2604-a321-43f5-ab68-05504629e8e2 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5639ee7f-381d-47f1-a9c7-2be382663d22]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:48 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:09:48 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:48 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe Feb 27 02:09:48 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:49 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-aeef2604-a321-43f5-ab68-05504629e8e2 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.394s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:49 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-aeef2604-a321-43f5-ab68-05504629e8e2 tempest-VolumesSnapshotTestJSON-1899760600 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:49 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-aeef2604-a321-43f5-ab68-05504629e8e2 tempest-VolumesSnapshotTestJSON-1899760600 None] Deleted volume successfully. Feb 27 02:09:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-aeef2604-a321-43f5-ab68-05504629e8e2 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-97ec1c3e-528a-4017-b10a-f966378bd238-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:49 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe" returned: 0 in 0.509s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:49 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Path /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-646cc51b-c29b-411e-a1d1-1745ab9ab823 not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:09:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-646cc51b-c29b-411e-a1d1-1745ab9ab823 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:49 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-646cc51b-c29b-411e-a1d1-1745ab9ab823 Feb 27 02:09:49 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:50 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Flow 'volume_create_manager' (7bc09db2-acea-49de-8f98-21a818e17f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a658bba5-636d-422e-ba22-71f768186fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a658bba5-636d-422e-ba22-71f768186fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1680867724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a4a9e1c5a54df790c5d1d965c2b141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:50Z,use_quota=True,user_id='e2924045897c4565be749d34f2f8bb04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b40c242-29ac-46b1-b77d-bc54191c3fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b40c242-29ac-46b1-b77d-bc54191c3fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879ccf4a-e8be-4ebd-8e09-5282c5629ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879ccf4a-e8be-4ebd-8e09-5282c5629ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b', 'volume_name': 'volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a636982-5ebd-4ba4-bfbb-95f3e3f068f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a636982-5ebd-4ba4-bfbb-95f3e3f068f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee22758-b349-4372-b903-c8edf110b798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:50 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Volume eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b', 'volume_size': 1} Feb 27 02:09:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:51 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-646cc51b-c29b-411e-a1d1-1745ab9ab823" returned: 0 in 2.646s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:51 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9abd568-13c4-4069-b78a-02b3e8e5e2b6]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:51 devstack sudo[89660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe Feb 27 02:09:51 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:52 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe" returned: 0 in 0.740s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:52 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Image conversion details: src /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe, size 1024.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-646cc51b-c29b-411e-a1d1-1745ab9ab823 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:09:52 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Converted 1024.00 MB image at 386.87 MB/s Feb 27 02:09:52 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-646cc51b-c29b-411e-a1d1-1745ab9ab823 is being set with open permissions: ugo+rw Feb 27 02:09:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-646cc51b-c29b-411e-a1d1-1745ab9ab823 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:52 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-646cc51b-c29b-411e-a1d1-1745ab9ab823 Feb 27 02:09:52 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:53 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-646cc51b-c29b-411e-a1d1-1745ab9ab823" returned: 0 in 0.477s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Lock "cinder-quobyte-646cc51b-c29b-411e-a1d1-1745ab9ab823" released by "_copy_volume_from_snapshot" :: held 4.953s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:53 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=145,cinder:INSERT=38,cinder:UPDATE=159,cinder:DELETE=17 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:09:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Acquiring lock "cinder-quobyte-7432bca3-d404-4d40-90e0-f5a7ffc2407d" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Lock "cinder-quobyte-7432bca3-d404-4d40-90e0-f5a7ffc2407d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Deleting offline snapshot 7432bca3-d404-4d40-90e0-f5a7ffc2407d of volume dc87d310-76f7-4314-9126-255849853efe {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] snapshot_file for this snap is: volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:09:53 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6023a18-1b1d-4813-aed3-50e610ef52c3]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:53 devstack sudo[89668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d Feb 27 02:09:53 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:53 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d" returned: 0 in 0.542s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc87d310-76f7-4314-9126-255849853efe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:53 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bebe364-e299-4cd9-8996-338f38a9a915]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:53 devstack sudo[89673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe Feb 27 02:09:53 devstack sudo[89673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:54 devstack sudo[89673]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe" returned: 0 in 0.556s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:54 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d Feb 27 02:09:54 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:54 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d" returned: 0 in 0.517s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:54 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d Feb 27 02:09:54 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:55 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe.7432bca3-d404-4d40-90e0-f5a7ffc2407d" returned: 0 in 0.457s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Lock "cinder-quobyte-7432bca3-d404-4d40-90e0-f5a7ffc2407d" released by "_delete_snapshot" :: held 2.137s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:55 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:INSERT=45,cinder:SELECT=133,cinder:UPDATE=168,cinder:DELETE=11 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:09:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.763s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.807s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1795311359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f066d5d3-b0ae-4613-8697-1c89292d1e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de08bd54d0144fd4ba9b9ff17c150c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:47Z,use_quota=True,user_id='db9ab1af218041ae9ae7d4290a6ab28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Creating volume f066d5d3-b0ae-4613-8697-1c89292d1e9d {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:55 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:09:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d 2147483648 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4134189-6922-4abe-a9a7-bca352b17fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-646cc51b-c29b-411e-a1d1-1745ab9ab823', 'volume_size': 1, 'source_volid': 'dc87d310-76f7-4314-9126-255849853efe', 'source_volstatus': 'available'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d580db8-57ae-4a21-b0a2-5eaaf4061bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:55 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d 2147483648 Feb 27 02:09:55 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:55 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Volume volume-646cc51b-c29b-411e-a1d1-1745ab9ab823 (646cc51b-c29b-411e-a1d1-1745ab9ab823): created successfully Feb 27 02:09:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d580db8-57ae-4a21-b0a2-5eaaf4061bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Flow 'volume_create_manager' (cd33143e-0826-48b7-a540-9d560de397db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:55 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b242c17b-681f-49aa-b207-3662abcb631b tempest-VolumesGetTest-224619659 None] Created volume successfully. Feb 27 02:09:55 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d 2147483648" returned: 0 in 0.500s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:55 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d Feb 27 02:09:55 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:56 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d" returned: 0 in 0.470s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.598s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1680867724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a4a9e1c5a54df790c5d1d965c2b141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:50Z,use_quota=True,user_id='e2924045897c4565be749d34f2f8bb04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Creating volume eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:56 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87ec866-0023-46f4-9c4f-f0b1cb619dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d', 'volume_size': 2}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:56 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b 1073741824 Feb 27 02:09:56 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711934aa-b2a0-4031-b973-384e7521e2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:56 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Volume volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d (f066d5d3-b0ae-4613-8697-1c89292d1e9d): created successfully Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711934aa-b2a0-4031-b973-384e7521e2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Flow 'volume_create_manager' (02ac9d98-1651-4450-a418-f3e1f43ff6f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:56 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-6020489c-2500-4fb5-a996-521932128913 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Created volume successfully. Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Flow 'volume_create_manager' (2f08899a-de12-4c45-8c13-cbdfbee2ac21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7892545f-c3e5-45f4-bb4c-a69a2fe63d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7892545f-c3e5-45f4-bb4c-a69a2fe63d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-972430839',display_name='tempest-VolumesGetTest-Volume-1344698353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa12952-5698-42f0-bc73-548c7ab3c9df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b88cd334c184fe4840951b76f36dfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:56Z,use_quota=True,user_id='983ac70ab90f4b01b9765356a9588944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7bd3bd-94ef-4062-bc75-5776689af83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7bd3bd-94ef-4062-bc75-5776689af83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42c1e20-d3db-4502-85d5-57ddd0c8b18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42c1e20-d3db-4502-85d5-57ddd0c8b18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fa12952-5698-42f0-bc73-548c7ab3c9df', 'volume_name': 'volume-9fa12952-5698-42f0-bc73-548c7ab3c9df', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db9fe8b-9773-41a0-8e54-460c172bc386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db9fe8b-9773-41a0-8e54-460c172bc386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd9d8ac-ef2b-44cc-9232-77c101974f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:56 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Volume 9fa12952-5698-42f0-bc73-548c7ab3c9df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fa12952-5698-42f0-bc73-548c7ab3c9df', 'volume_size': 1} Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:56 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b 1073741824" returned: 0 in 0.746s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:57 devstack sudo[89699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b Feb 27 02:09:57 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5a9b2c59-4eca-41a2-a191-d1ef0d7a4e13 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:57 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b" returned: 0 in 0.501s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.931s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-972430839',display_name='tempest-VolumesGetTest-Volume-1344698353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa12952-5698-42f0-bc73-548c7ab3c9df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b88cd334c184fe4840951b76f36dfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:56Z,use_quota=True,user_id='983ac70ab90f4b01b9765356a9588944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Creating volume 9fa12952-5698-42f0-bc73-548c7ab3c9df {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:57 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:09:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9fa12952-5698-42f0-bc73-548c7ab3c9df 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:57 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9fa12952-5698-42f0-bc73-548c7ab3c9df 1073741824 Feb 27 02:09:57 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee22758-b349-4372-b903-c8edf110b798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06aa9a55-0e98-4495-812a-d31357f6914d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:57 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Volume volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b (eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b): created successfully Feb 27 02:09:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06aa9a55-0e98-4495-812a-d31357f6914d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:57 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Flow 'volume_create_manager' (7bc09db2-acea-49de-8f98-21a818e17f06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:57 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-dbaca2ce-d832-4fbd-9c59-a2c4e7faebb1 tempest-VolumesSnapshotTestJSON-1899760600 None] Created volume successfully. Feb 27 02:09:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4beadbf6-1ac5-48a6-b5c3-4c46e407b6e5 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:58 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9fa12952-5698-42f0-bc73-548c7ab3c9df 1073741824" returned: 0 in 0.677s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9fa12952-5698-42f0-bc73-548c7ab3c9df {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:58 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9fa12952-5698-42f0-bc73-548c7ab3c9df Feb 27 02:09:58 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:58 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9fa12952-5698-42f0-bc73-548c7ab3c9df" returned: 0 in 0.573s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5a9b2c59-4eca-41a2-a191-d1ef0d7a4e13 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.642s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd9d8ac-ef2b-44cc-9232-77c101974f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fa12952-5698-42f0-bc73-548c7ab3c9df', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794ac1c4-f935-4593-8382-5db6f2343096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-5a9b2c59-4eca-41a2-a191-d1ef0d7a4e13 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Creating offline snapshot c8655e3f-c4a6-4bc4-be92-e64649d1c7f6 of volume f066d5d3-b0ae-4613-8697-1c89292d1e9d {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:09:58 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Volume volume-9fa12952-5698-42f0-bc73-548c7ab3c9df (9fa12952-5698-42f0-bc73-548c7ab3c9df): created successfully Feb 27 02:09:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794ac1c4-f935-4593-8382-5db6f2343096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Flow 'volume_create_manager' (2f08899a-de12-4c45-8c13-cbdfbee2ac21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:58 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[67392c3f-f697-4b30-a6a8-2ee50e97a2b4]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5a9b2c59-4eca-41a2-a191-d1ef0d7a4e13 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:58 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-0988cb11-b427-45c1-9193-237612e3cf91 tempest-VolumesGetTest-224619659 None] Created volume successfully. Feb 27 02:09:58 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d Feb 27 02:09:58 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:59 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5a9b2c59-4eca-41a2-a191-d1ef0d7a4e13 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d" returned: 0 in 0.624s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5a9b2c59-4eca-41a2-a191-d1ef0d7a4e13 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.c8655e3f-c4a6-4bc4-be92-e64649d1c7f6 2G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:59 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.c8655e3f-c4a6-4bc4-be92-e64649d1c7f6 2G Feb 27 02:09:59 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f85cd6de-25de-455e-9040-af231681a6b9 tempest-VolumesGetTest-224619659 None] Acquiring lock "cinder-9fa12952-5698-42f0-bc73-548c7ab3c9df-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f85cd6de-25de-455e-9040-af231681a6b9 tempest-VolumesGetTest-224619659 None] Lock "cinder-9fa12952-5698-42f0-bc73-548c7ab3c9df-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f85cd6de-25de-455e-9040-af231681a6b9 tempest-VolumesGetTest-224619659 None] Acquiring lock "cinder-quobyte-9fa12952-5698-42f0-bc73-548c7ab3c9df" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f85cd6de-25de-455e-9040-af231681a6b9 tempest-VolumesGetTest-224619659 None] Lock "cinder-quobyte-9fa12952-5698-42f0-bc73-548c7ab3c9df" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:59 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38bedc2-3861-4913-beef-7fbb0da15aeb]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f85cd6de-25de-455e-9040-af231681a6b9 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9fa12952-5698-42f0-bc73-548c7ab3c9df {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:00 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9fa12952-5698-42f0-bc73-548c7ab3c9df Feb 27 02:10:00 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:00 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5a9b2c59-4eca-41a2-a191-d1ef0d7a4e13 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.c8655e3f-c4a6-4bc4-be92-e64649d1c7f6 2G" returned: 0 in 0.619s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5a9b2c59-4eca-41a2-a191-d1ef0d7a4e13 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.c8655e3f-c4a6-4bc4-be92-e64649d1c7f6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:00 devstack sudo[89724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.c8655e3f-c4a6-4bc4-be92-e64649d1c7f6 Feb 27 02:10:00 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:00 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f85cd6de-25de-455e-9040-af231681a6b9 tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9fa12952-5698-42f0-bc73-548c7ab3c9df" returned: 0 in 0.631s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f85cd6de-25de-455e-9040-af231681a6b9 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9fa12952-5698-42f0-bc73-548c7ab3c9df {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:00 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9fa12952-5698-42f0-bc73-548c7ab3c9df Feb 27 02:10:00 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:00 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5a9b2c59-4eca-41a2-a191-d1ef0d7a4e13 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.c8655e3f-c4a6-4bc4-be92-e64649d1c7f6" returned: 0 in 0.551s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:00 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-5a9b2c59-4eca-41a2-a191-d1ef0d7a4e13 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.c8655e3f-c4a6-4bc4-be92-e64649d1c7f6 is being set with open permissions: ugo+rw Feb 27 02:10:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5a9b2c59-4eca-41a2-a191-d1ef0d7a4e13 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.c8655e3f-c4a6-4bc4-be92-e64649d1c7f6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:00 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.c8655e3f-c4a6-4bc4-be92-e64649d1c7f6 Feb 27 02:10:00 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:01 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5a9b2c59-4eca-41a2-a191-d1ef0d7a4e13 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.c8655e3f-c4a6-4bc4-be92-e64649d1c7f6" returned: 0 in 0.420s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:01 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f85cd6de-25de-455e-9040-af231681a6b9 tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9fa12952-5698-42f0-bc73-548c7ab3c9df" returned: 0 in 0.583s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f85cd6de-25de-455e-9040-af231681a6b9 tempest-VolumesGetTest-224619659 None] Lock "cinder-quobyte-9fa12952-5698-42f0-bc73-548c7ab3c9df" released by "delete_volume" :: held 1.247s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5a9b2c59-4eca-41a2-a191-d1ef0d7a4e13 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:01 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.info Feb 27 02:10:01 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:01 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-f85cd6de-25de-455e-9040-af231681a6b9 tempest-VolumesGetTest-224619659 None] Created reservations ['6a23d503-09fa-4e5c-a94f-5c0859b77f6c', 'a5240f9f-ba55-4346-806e-3960f4584a31', 'fc621766-19a2-4aca-8aaa-706a6ffe5d19', 'd06a97a9-c00b-4fe8-a76b-4518a2a03694'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f85cd6de-25de-455e-9040-af231681a6b9 tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f85cd6de-25de-455e-9040-af231681a6b9 tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f85cd6de-25de-455e-9040-af231681a6b9 tempest-VolumesGetTest-224619659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:01 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f85cd6de-25de-455e-9040-af231681a6b9 tempest-VolumesGetTest-224619659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f85cd6de-25de-455e-9040-af231681a6b9 tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f85cd6de-25de-455e-9040-af231681a6b9 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:01 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:01 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:01 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f85cd6de-25de-455e-9040-af231681a6b9 tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.470s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:01 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-f85cd6de-25de-455e-9040-af231681a6b9 tempest-VolumesGetTest-224619659 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:01 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f85cd6de-25de-455e-9040-af231681a6b9 tempest-VolumesGetTest-224619659 None] Deleted volume successfully. Feb 27 02:10:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f85cd6de-25de-455e-9040-af231681a6b9 tempest-VolumesGetTest-224619659 None] Lock "cinder-9fa12952-5698-42f0-bc73-548c7ab3c9df-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:01 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5a9b2c59-4eca-41a2-a191-d1ef0d7a4e13 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.info" returned: 0 in 0.605s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:01 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-5a9b2c59-4eca-41a2-a191-d1ef0d7a4e13 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.info is being set with open permissions: ugo+rw Feb 27 02:10:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5a9b2c59-4eca-41a2-a191-d1ef0d7a4e13 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:01 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.info Feb 27 02:10:01 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-57b2bfac-3da5-4f9c-89ec-709a8a697a95 tempest-VolumesGetTest-224619659 None] Acquiring lock "cinder-646cc51b-c29b-411e-a1d1-1745ab9ab823-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-57b2bfac-3da5-4f9c-89ec-709a8a697a95 tempest-VolumesGetTest-224619659 None] Lock "cinder-646cc51b-c29b-411e-a1d1-1745ab9ab823-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-57b2bfac-3da5-4f9c-89ec-709a8a697a95 tempest-VolumesGetTest-224619659 None] Acquiring lock "cinder-quobyte-646cc51b-c29b-411e-a1d1-1745ab9ab823" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-57b2bfac-3da5-4f9c-89ec-709a8a697a95 tempest-VolumesGetTest-224619659 None] Lock "cinder-quobyte-646cc51b-c29b-411e-a1d1-1745ab9ab823" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:02 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4304068d-cd5a-4565-9beb-d0c8366e1a37]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-57b2bfac-3da5-4f9c-89ec-709a8a697a95 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-646cc51b-c29b-411e-a1d1-1745ab9ab823 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:02 devstack sudo[89747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-646cc51b-c29b-411e-a1d1-1745ab9ab823 Feb 27 02:10:02 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:02 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5a9b2c59-4eca-41a2-a191-d1ef0d7a4e13 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.info" returned: 0 in 0.605s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5a9b2c59-4eca-41a2-a191-d1ef0d7a4e13 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.553s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4beadbf6-1ac5-48a6-b5c3-4c46e407b6e5 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.307s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-4beadbf6-1ac5-48a6-b5c3-4c46e407b6e5 tempest-VolumesSnapshotTestJSON-1899760600 None] Creating offline snapshot 5d89cb15-b248-4810-a362-4420fcfd67f8 of volume eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:10:02 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83abf09-c1fd-48e2-ba6f-8535c87e958d]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4beadbf6-1ac5-48a6-b5c3-4c46e407b6e5 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:02 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-5a9b2c59-4eca-41a2-a191-d1ef0d7a4e13 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Create snapshot completed successfully Feb 27 02:10:02 devstack sudo[89749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b Feb 27 02:10:02 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:02 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-57b2bfac-3da5-4f9c-89ec-709a8a697a95 tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-646cc51b-c29b-411e-a1d1-1745ab9ab823" returned: 0 in 0.633s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-57b2bfac-3da5-4f9c-89ec-709a8a697a95 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-646cc51b-c29b-411e-a1d1-1745ab9ab823 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:02 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-646cc51b-c29b-411e-a1d1-1745ab9ab823 Feb 27 02:10:02 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:02 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4beadbf6-1ac5-48a6-b5c3-4c46e407b6e5 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b" returned: 0 in 0.525s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4beadbf6-1ac5-48a6-b5c3-4c46e407b6e5 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:02 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8 1G Feb 27 02:10:02 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:03 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-57b2bfac-3da5-4f9c-89ec-709a8a697a95 tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-646cc51b-c29b-411e-a1d1-1745ab9ab823" returned: 0 in 0.519s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-57b2bfac-3da5-4f9c-89ec-709a8a697a95 tempest-VolumesGetTest-224619659 None] Lock "cinder-quobyte-646cc51b-c29b-411e-a1d1-1745ab9ab823" released by "delete_volume" :: held 1.179s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-57b2bfac-3da5-4f9c-89ec-709a8a697a95 tempest-VolumesGetTest-224619659 None] Created reservations ['9c728024-89c9-4662-ae41-bb676b8181e4', 'a55c8244-fb73-4e9d-8b6d-1c0da0968ca5', '4c3dee89-0cc9-4457-a8a8-a434e0b1fa0e', '3976330c-da13-4203-81ce-d8b71bb65f47'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Acquiring lock "cinder-c8655e3f-c4a6-4bc4-be92-e64649d1c7f6-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-57b2bfac-3da5-4f9c-89ec-709a8a697a95 tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-57b2bfac-3da5-4f9c-89ec-709a8a697a95 tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-57b2bfac-3da5-4f9c-89ec-709a8a697a95 tempest-VolumesGetTest-224619659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-57b2bfac-3da5-4f9c-89ec-709a8a697a95 tempest-VolumesGetTest-224619659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-57b2bfac-3da5-4f9c-89ec-709a8a697a95 tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-57b2bfac-3da5-4f9c-89ec-709a8a697a95 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Lock "cinder-c8655e3f-c4a6-4bc4-be92-e64649d1c7f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Acquiring lock "cinder-quobyte-f066d5d3-b0ae-4613-8697-1c89292d1e9d" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Lock "cinder-quobyte-f066d5d3-b0ae-4613-8697-1c89292d1e9d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:03 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Acquiring lock "cinder-quobyte-c8655e3f-c4a6-4bc4-be92-e64649d1c7f6" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:03 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Lock "cinder-quobyte-c8655e3f-c4a6-4bc4-be92-e64649d1c7f6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Deleting offline snapshot c8655e3f-c4a6-4bc4-be92-e64649d1c7f6 of volume f066d5d3-b0ae-4613-8697-1c89292d1e9d {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] snapshot_file for this snap is: volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.c8655e3f-c4a6-4bc4-be92-e64649d1c7f6 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3662ecf6-34e6-4336-8d66-5c37a32d3694]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.c8655e3f-c4a6-4bc4-be92-e64649d1c7f6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:03 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4beadbf6-1ac5-48a6-b5c3-4c46e407b6e5 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8 1G" returned: 0 in 0.699s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4beadbf6-1ac5-48a6-b5c3-4c46e407b6e5 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:03 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.c8655e3f-c4a6-4bc4-be92-e64649d1c7f6 Feb 27 02:10:03 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:03 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8 Feb 27 02:10:03 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:03 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-57b2bfac-3da5-4f9c-89ec-709a8a697a95 tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.446s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:03 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-57b2bfac-3da5-4f9c-89ec-709a8a697a95 tempest-VolumesGetTest-224619659 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:03 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-57b2bfac-3da5-4f9c-89ec-709a8a697a95 tempest-VolumesGetTest-224619659 None] Deleted volume successfully. Feb 27 02:10:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-57b2bfac-3da5-4f9c-89ec-709a8a697a95 tempest-VolumesGetTest-224619659 None] Lock "cinder-646cc51b-c29b-411e-a1d1-1745ab9ab823-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:04 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.c8655e3f-c4a6-4bc4-be92-e64649d1c7f6" returned: 0 in 0.484s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:10:04 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99f6a1a-99c5-4879-b027-df2928afa573]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:04 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:04 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d Feb 27 02:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4beadbf6-1ac5-48a6-b5c3-4c46e407b6e5 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8" returned: 0 in 0.510s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:04 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:04 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-4beadbf6-1ac5-48a6-b5c3-4c46e407b6e5 tempest-VolumesSnapshotTestJSON-1899760600 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8 is being set with open permissions: ugo+rw Feb 27 02:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4beadbf6-1ac5-48a6-b5c3-4c46e407b6e5 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:04 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8 Feb 27 02:10:04 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8718e897-5372-46b8-9013-07cc2a702e01 tempest-VolumesGetTest-224619659 None] Acquiring lock "cinder-dc87d310-76f7-4314-9126-255849853efe-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8718e897-5372-46b8-9013-07cc2a702e01 tempest-VolumesGetTest-224619659 None] Lock "cinder-dc87d310-76f7-4314-9126-255849853efe-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8718e897-5372-46b8-9013-07cc2a702e01 tempest-VolumesGetTest-224619659 None] Acquiring lock "cinder-quobyte-dc87d310-76f7-4314-9126-255849853efe" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8718e897-5372-46b8-9013-07cc2a702e01 tempest-VolumesGetTest-224619659 None] Lock "cinder-quobyte-dc87d310-76f7-4314-9126-255849853efe" acquired by "delete_volume" :: waited 0.006s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:04 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38307d2-d475-42d8-bc84-457a6316fa9a]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8718e897-5372-46b8-9013-07cc2a702e01 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:04 devstack sudo[89782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe Feb 27 02:10:04 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:04 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d" returned: 0 in 0.577s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.c8655e3f-c4a6-4bc4-be92-e64649d1c7f6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:04 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4beadbf6-1ac5-48a6-b5c3-4c46e407b6e5 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8" returned: 0 in 0.521s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:04 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.c8655e3f-c4a6-4bc4-be92-e64649d1c7f6 Feb 27 02:10:04 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4beadbf6-1ac5-48a6-b5c3-4c46e407b6e5 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:04 devstack sudo[89790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.info Feb 27 02:10:04 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:05 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8718e897-5372-46b8-9013-07cc2a702e01 tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe" returned: 0 in 0.478s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8718e897-5372-46b8-9013-07cc2a702e01 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:05 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe Feb 27 02:10:05 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:05 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4beadbf6-1ac5-48a6-b5c3-4c46e407b6e5 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.info" returned: 0 in 0.430s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:05 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-4beadbf6-1ac5-48a6-b5c3-4c46e407b6e5 tempest-VolumesSnapshotTestJSON-1899760600 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.info is being set with open permissions: ugo+rw Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4beadbf6-1ac5-48a6-b5c3-4c46e407b6e5 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:05 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.info Feb 27 02:10:05 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:05 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.c8655e3f-c4a6-4bc4-be92-e64649d1c7f6" returned: 0 in 0.579s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.c8655e3f-c4a6-4bc4-be92-e64649d1c7f6 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:05 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.c8655e3f-c4a6-4bc4-be92-e64649d1c7f6 Feb 27 02:10:05 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:05 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8718e897-5372-46b8-9013-07cc2a702e01 tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-dc87d310-76f7-4314-9126-255849853efe" returned: 0 in 0.473s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8718e897-5372-46b8-9013-07cc2a702e01 tempest-VolumesGetTest-224619659 None] Lock "cinder-quobyte-dc87d310-76f7-4314-9126-255849853efe" released by "delete_volume" :: held 0.996s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:05 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-8718e897-5372-46b8-9013-07cc2a702e01 tempest-VolumesGetTest-224619659 None] Created reservations ['69fa9e9f-db2c-4dc7-9560-fc2ecd07dfd2', '8b4d3d68-3b1e-4b15-b939-51a995e59ffb', '3bdc28bd-8cf7-4206-b391-6ddb29170e56', '723bae27-f01a-4813-94f9-46aa76f7f682'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4beadbf6-1ac5-48a6-b5c3-4c46e407b6e5 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.info" returned: 0 in 0.420s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4beadbf6-1ac5-48a6-b5c3-4c46e407b6e5 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.181s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:05 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-4beadbf6-1ac5-48a6-b5c3-4c46e407b6e5 tempest-VolumesSnapshotTestJSON-1899760600 None] Create snapshot completed successfully Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8718e897-5372-46b8-9013-07cc2a702e01 tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8718e897-5372-46b8-9013-07cc2a702e01 tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8718e897-5372-46b8-9013-07cc2a702e01 tempest-VolumesGetTest-224619659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8718e897-5372-46b8-9013-07cc2a702e01 tempest-VolumesGetTest-224619659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8718e897-5372-46b8-9013-07cc2a702e01 tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8718e897-5372-46b8-9013-07cc2a702e01 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:05 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:05 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:05 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d.c8655e3f-c4a6-4bc4-be92-e64649d1c7f6" returned: 0 in 0.433s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Lock "cinder-quobyte-c8655e3f-c4a6-4bc4-be92-e64649d1c7f6" released by "_delete_snapshot" :: held 2.146s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Lock "cinder-quobyte-f066d5d3-b0ae-4613-8697-1c89292d1e9d" released by "delete_snapshot" :: held 2.163s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Created reservations ['2afe3424-30da-42e2-824a-4d764b07119b', 'f317bd71-7dde-4a79-94a7-2bd9f5b1d6aa', 'd497237a-3290-4489-99dd-685c6a2dccf3', 'b48cc84d-f1d5-46c9-877d-2aaf92990dfa'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:05 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Delete snapshot completed successfully. Feb 27 02:10:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-07ef0774-ee5a-4f18-a1a2-68bd1106bec3 tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Lock "cinder-c8655e3f-c4a6-4bc4-be92-e64649d1c7f6-delete_snapshot" released by "delete_snapshot" :: held 2.256s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:06 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8718e897-5372-46b8-9013-07cc2a702e01 tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.414s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-8718e897-5372-46b8-9013-07cc2a702e01 tempest-VolumesGetTest-224619659 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:06 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8718e897-5372-46b8-9013-07cc2a702e01 tempest-VolumesGetTest-224619659 None] Deleted volume successfully. Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8718e897-5372-46b8-9013-07cc2a702e01 tempest-VolumesGetTest-224619659 None] Lock "cinder-dc87d310-76f7-4314-9126-255849853efe-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Flow 'volume_create_manager' (45d2980d-6a21-43a7-bab9-7c11fd398e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a575834-df7d-4658-b4f1-150161ff3395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a575834-df7d-4658-b4f1-150161ff3395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1679816863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04dab9de-ec02-4ebf-a7ce-e0e56c364057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a4a9e1c5a54df790c5d1d965c2b141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5d89cb15-b248-4810-a362-4420fcfd67f8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:07Z,use_quota=True,user_id='e2924045897c4565be749d34f2f8bb04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5aa837-fb16-4a2e-ae16-b1f7dab098f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5aa837-fb16-4a2e-ae16-b1f7dab098f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cfc9a9-a643-473b-9593-dbf10ef4b225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cfc9a9-a643-473b-9593-dbf10ef4b225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '04dab9de-ec02-4ebf-a7ce-e0e56c364057', 'volume_name': 'volume-04dab9de-ec02-4ebf-a7ce-e0e56c364057', 'volume_size': 1, 'snapshot_id': '5d89cb15-b248-4810-a362-4420fcfd67f8'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9583483-8a34-4d09-a7e4-4f1bf06d20b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9583483-8a34-4d09-a7e4-4f1bf06d20b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d62db5a-1a0b-40f2-89ae-ed8005c274d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:06 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Volume 04dab9de-ec02-4ebf-a7ce-e0e56c364057: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-04dab9de-ec02-4ebf-a7ce-e0e56c364057', 'volume_size': 1, 'snapshot_id': '5d89cb15-b248-4810-a362-4420fcfd67f8'} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-quobyte-5d89cb15-b248-4810-a362-4420fcfd67f8-04dab9de-ec02-4ebf-a7ce-e0e56c364057" by "_create_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-24056874-c872-42af-b7b3-f41980cfa46f tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Acquiring lock "cinder-f066d5d3-b0ae-4613-8697-1c89292d1e9d-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-5d89cb15-b248-4810-a362-4420fcfd67f8-04dab9de-ec02-4ebf-a7ce-e0e56c364057" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Creating volume 04dab9de-ec02-4ebf-a7ce-e0e56c364057 from snapshot 5d89cb15-b248-4810-a362-4420fcfd67f8 {{(pid=83167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-quobyte-04dab9de-ec02-4ebf-a7ce-e0e56c364057" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-24056874-c872-42af-b7b3-f41980cfa46f tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Lock "cinder-f066d5d3-b0ae-4613-8697-1c89292d1e9d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-04dab9de-ec02-4ebf-a7ce-e0e56c364057" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] snapshot: 5d89cb15-b248-4810-a362-4420fcfd67f8, volume: 04dab9de-ec02-4ebf-a7ce-e0e56c364057, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d624fff5-939c-46a6-a6a5-bca3dac50938]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-24056874-c872-42af-b7b3-f41980cfa46f tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Acquiring lock "cinder-quobyte-f066d5d3-b0ae-4613-8697-1c89292d1e9d" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-24056874-c872-42af-b7b3-f41980cfa46f tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Lock "cinder-quobyte-f066d5d3-b0ae-4613-8697-1c89292d1e9d" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3e3315-83ca-4204-8381-8f2362e86cff]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-24056874-c872-42af-b7b3-f41980cfa46f tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:06 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8 Feb 27 02:10:06 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:07 devstack sudo[89813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d Feb 27 02:10:07 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Flow 'volume_create_manager' (2e5dd57f-0536-4a5c-bc5e-ac82da1c9578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41ce7ee-8b72-4abb-9f42-d05e90e4673b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41ce7ee-8b72-4abb-9f42-d05e90e4673b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1809727001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3613583-024b-4687-9b81-1478e073e004,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2b88cd334c184fe4840951b76f36dfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:07Z,use_quota=True,user_id='983ac70ab90f4b01b9765356a9588944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee1da330-cb6d-4119-8049-aa964df4b9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee1da330-cb6d-4119-8049-aa964df4b9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee4f7f4-b2f9-4fee-8b21-b98958b28624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG cinder.image.glance [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Creating Keystone auth plugin from conf {{(pid=83167) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 02:10:07 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8" returned: 0 in 0.524s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4fb2de-d59a-4ff3-b0a4-1c06156790c6]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:07 devstack sudo[89819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b Feb 27 02:10:07 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:07 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-24056874-c872-42af-b7b3-f41980cfa46f tempest-VolumesSnapshotNegativeTestJSON-575079110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d" returned: 0 in 0.620s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-24056874-c872-42af-b7b3-f41980cfa46f tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:07 devstack sudo[89823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d Feb 27 02:10:07 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee4f7f4-b2f9-4fee-8b21-b98958b28624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e3613583-024b-4687-9b81-1478e073e004', 'volume_name': 'volume-e3613583-024b-4687-9b81-1478e073e004', 'volume_size': 1, 'image_id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c3ebea7eea44d62b013a3b663b3a45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74e16fab-69df-4cb3-99da-0b06bc338767/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff321c44-f38d-49c5-ab44-b1a01e4b6839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff321c44-f38d-49c5-ab44-b1a01e4b6839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453abf77-c563-48db-a43e-8032e445f1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:07 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Volume e3613583-024b-4687-9b81-1478e073e004: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e3613583-024b-4687-9b81-1478e073e004', 'volume_size': 1, 'image_id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c3ebea7eea44d62b013a3b663b3a45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74e16fab-69df-4cb3-99da-0b06bc338767/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Trying to clone e3613583-024b-4687-9b81-1478e073e004 from image 74e16fab-69df-4cb3-99da-0b06bc338767 at location (None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}]). {{(pid=83167) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_ewnw0xxldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 02:10:07 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Image download 20.69 MB at 20.69 MB/s Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b027e4-effb-4940-94ee-0731f055bc63]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_ewnw0xxldevstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:07 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_ewnw0xxldevstack@QuobyteHD Feb 27 02:10:07 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:08 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b" returned: 0 in 0.587s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:08 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Path /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-04dab9de-ec02-4ebf-a7ce-e0e56c364057 not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:10:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-04dab9de-ec02-4ebf-a7ce-e0e56c364057 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:08 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-04dab9de-ec02-4ebf-a7ce-e0e56c364057 Feb 27 02:10:08 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:08 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-24056874-c872-42af-b7b3-f41980cfa46f tempest-VolumesSnapshotNegativeTestJSON-575079110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f066d5d3-b0ae-4613-8697-1c89292d1e9d" returned: 0 in 0.476s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-24056874-c872-42af-b7b3-f41980cfa46f tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Lock "cinder-quobyte-f066d5d3-b0ae-4613-8697-1c89292d1e9d" released by "delete_volume" :: held 1.146s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:08 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-24056874-c872-42af-b7b3-f41980cfa46f tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Created reservations ['65735f73-96d9-47a7-9600-7382ad078e37', '15ff0313-60cc-43d0-bdf1-9714eb86a231', '31cb82ba-e024-45d3-bb14-c0a53dcb4ca7', '2f186ee2-7ae1-4a19-ab81-a79963df1d7c'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-24056874-c872-42af-b7b3-f41980cfa46f tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-24056874-c872-42af-b7b3-f41980cfa46f tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-24056874-c872-42af-b7b3-f41980cfa46f tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-24056874-c872-42af-b7b3-f41980cfa46f tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-24056874-c872-42af-b7b3-f41980cfa46f tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-24056874-c872-42af-b7b3-f41980cfa46f tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:08 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:08 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:08 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_ewnw0xxldevstack@QuobyteHD" returned: 0 in 0.522s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:08 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Temporary image 74e16fab-69df-4cb3-99da-0b06bc338767 is fetched for user 983ac70ab90f4b01b9765356a9588944. {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 02:10:08 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3322c8e1-b50e-4d82-8d76-6dfb38f6c4d6]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_ewnw0xxldevstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:08 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_ewnw0xxldevstack@QuobyteHD Feb 27 02:10:08 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:08 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-24056874-c872-42af-b7b3-f41980cfa46f tempest-VolumesSnapshotNegativeTestJSON-575079110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.559s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:08 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-24056874-c872-42af-b7b3-f41980cfa46f tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:08 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-24056874-c872-42af-b7b3-f41980cfa46f tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Deleted volume successfully. Feb 27 02:10:08 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-24056874-c872-42af-b7b3-f41980cfa46f tempest-VolumesSnapshotNegativeTestJSON-575079110 None] Lock "cinder-f066d5d3-b0ae-4613-8697-1c89292d1e9d-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:10 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_ewnw0xxldevstack@QuobyteHD" returned: 0 in 1.953s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:10 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-04dab9de-ec02-4ebf-a7ce-e0e56c364057" returned: 0 in 2.469s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:10 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df1899c-f5c9-4e43-98a6-d4c929a8ba7f]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:10 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b Feb 27 02:10:10 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:11 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b" returned: 0 in 0.677s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Image conversion details: src /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b, size 1024.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-04dab9de-ec02-4ebf-a7ce-e0e56c364057 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:10:11 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Converted 1024.00 MB image at 414.53 MB/s Feb 27 02:10:11 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-04dab9de-ec02-4ebf-a7ce-e0e56c364057 is being set with open permissions: ugo+rw Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-04dab9de-ec02-4ebf-a7ce-e0e56c364057 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:11 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-04dab9de-ec02-4ebf-a7ce-e0e56c364057 Feb 27 02:10:11 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:11 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-04dab9de-ec02-4ebf-a7ce-e0e56c364057" returned: 0 in 0.471s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-04dab9de-ec02-4ebf-a7ce-e0e56c364057" released by "_copy_volume_from_snapshot" :: held 4.821s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-5d89cb15-b248-4810-a362-4420fcfd67f8-04dab9de-ec02-4ebf-a7ce-e0e56c364057" released by "_create_volume_from_snapshot" :: held 4.849s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.864s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.283s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1809727001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3613583-024b-4687-9b81-1478e073e004,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2b88cd334c184fe4840951b76f36dfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:07Z,use_quota=True,user_id='983ac70ab90f4b01b9765356a9588944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Creating volume e3613583-024b-4687-9b81-1478e073e004 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:11 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:11 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 1073741824 Feb 27 02:10:11 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d62db5a-1a0b-40f2-89ae-ed8005c274d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04dab9de-ec02-4ebf-a7ce-e0e56c364057', 'volume_size': 1, 'snapshot_id': '5d89cb15-b248-4810-a362-4420fcfd67f8'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbecde4d-df43-488a-b994-4660e4636816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:11 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Volume volume-04dab9de-ec02-4ebf-a7ce-e0e56c364057 (04dab9de-ec02-4ebf-a7ce-e0e56c364057): created successfully Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbecde4d-df43-488a-b994-4660e4636816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Flow 'volume_create_manager' (45d2980d-6a21-43a7-bab9-7c11fd398e2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:11 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2cacbeb3-ab61-4134-b387-710f8e3622cf tempest-VolumesSnapshotTestJSON-1899760600 None] Created volume successfully. Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Flow 'volume_create_manager' (d4bdafad-07fd-48cf-b114-2be20e8a58a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13bfb5f9-de65-447e-b880-2c4081633d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13bfb5f9-de65-447e-b880-2c4081633d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-245537047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17178a57-21c2-45c1-ac17-03a09ba6977b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c4c47c985f4f7b9898e2bcec402877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:12Z,use_quota=True,user_id='d5c8cd70c62748f6877cd533402f00a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baae924a-d9e5-4e57-ae99-cf84c645f982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baae924a-d9e5-4e57-ae99-cf84c645f982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ba7b74-a6b9-4305-8fa5-ea6f95e41a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ba7b74-a6b9-4305-8fa5-ea6f95e41a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17178a57-21c2-45c1-ac17-03a09ba6977b', 'volume_name': 'volume-17178a57-21c2-45c1-ac17-03a09ba6977b', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f177975-f3f4-485d-818f-5b48716576ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f177975-f3f4-485d-818f-5b48716576ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9c7aadc-3a67-4cf7-a3a7-76f019af5acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Volume 17178a57-21c2-45c1-ac17-03a09ba6977b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17178a57-21c2-45c1-ac17-03a09ba6977b', 'volume_size': 1} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:12 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 1073741824" returned: 0 in 0.617s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9aab5969-7346-4eb9-8e7b-9cecbc331d9b tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-04dab9de-ec02-4ebf-a7ce-e0e56c364057-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:12 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 Feb 27 02:10:12 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9aab5969-7346-4eb9-8e7b-9cecbc331d9b tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-04dab9de-ec02-4ebf-a7ce-e0e56c364057-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9aab5969-7346-4eb9-8e7b-9cecbc331d9b tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-quobyte-04dab9de-ec02-4ebf-a7ce-e0e56c364057" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9aab5969-7346-4eb9-8e7b-9cecbc331d9b tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-04dab9de-ec02-4ebf-a7ce-e0e56c364057" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5c7369-7704-46e9-acd5-10ca8eacc890]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9aab5969-7346-4eb9-8e7b-9cecbc331d9b tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-04dab9de-ec02-4ebf-a7ce-e0e56c364057 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Flow 'volume_create_manager' (a4910046-3a13-4343-92ae-a1cb705338ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc5e06d3-6c6c-4f62-a7e6-6a3145767e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc5e06d3-6c6c-4f62-a7e6-6a3145767e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-397655306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c4c47c985f4f7b9898e2bcec402877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:12Z,use_quota=True,user_id='d5c8cd70c62748f6877cd533402f00a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf958cb-7159-4744-ac17-10009fdae03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf958cb-7159-4744-ac17-10009fdae03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27ee3d5-9786-4561-a01d-809774a02e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d27ee3d5-9786-4561-a01d-809774a02e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5', 'volume_name': 'volume-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa7010d-eef7-4abd-9e79-91c9b931e118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-04dab9de-ec02-4ebf-a7ce-e0e56c364057 Feb 27 02:10:12 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa7010d-eef7-4abd-9e79-91c9b931e118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de44aaec-ee5f-4777-8a24-fdcb025f9d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Volume 9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5', 'volume_size': 1} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Flow 'volume_create_manager' (d97a24c1-9fcb-46c1-9084-ff506ce413a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (654ee6d8-9a9f-4c01-a967-54915268794c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (654ee6d8-9a9f-4c01-a967-54915268794c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-390838039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511ef7bb-725b-4a8e-9ffb-e0579a76fc68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c4c47c985f4f7b9898e2bcec402877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:13Z,use_quota=True,user_id='d5c8cd70c62748f6877cd533402f00a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace30420-9477-4d85-95a1-c5ab61a908d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace30420-9477-4d85-95a1-c5ab61a908d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95514698-ea7b-44c9-9efc-f4696879288a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95514698-ea7b-44c9-9efc-f4696879288a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '511ef7bb-725b-4a8e-9ffb-e0579a76fc68', 'volume_name': 'volume-511ef7bb-725b-4a8e-9ffb-e0579a76fc68', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (673e627d-9d49-46c0-9a98-0d7de0e63468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (673e627d-9d49-46c0-9a98-0d7de0e63468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475b4e19-473a-4fd7-acc7-e723d33d887b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Volume 511ef7bb-725b-4a8e-9ffb-e0579a76fc68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-511ef7bb-725b-4a8e-9ffb-e0579a76fc68', 'volume_size': 1} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Flow 'volume_create_manager' (6e0fafe1-f5d9-467c-afe7-db5bff127ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f1ae76-517a-4c28-86d0-c9b70ba3b104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f1ae76-517a-4c28-86d0-c9b70ba3b104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-133000890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e61fbba-6fee-453f-97d2-13341c67c9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c4c47c985f4f7b9898e2bcec402877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:13Z,use_quota=True,user_id='d5c8cd70c62748f6877cd533402f00a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62a714f-8a6f-41ef-8895-ef748695b32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62a714f-8a6f-41ef-8895-ef748695b32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728260fa-7a1d-46e0-b90c-ef10f600e82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728260fa-7a1d-46e0-b90c-ef10f600e82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e61fbba-6fee-453f-97d2-13341c67c9f8', 'volume_name': 'volume-4e61fbba-6fee-453f-97d2-13341c67c9f8', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc167b1a-695f-4964-ae83-f14915bf7857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc167b1a-695f-4964-ae83-f14915bf7857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0d281b8-afe7-4a1b-80bb-78416e508a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:12 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Volume 4e61fbba-6fee-453f-97d2-13341c67c9f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e61fbba-6fee-453f-97d2-13341c67c9f8', 'volume_size': 1} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004" returned: 0 in 0.650s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.735s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-245537047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17178a57-21c2-45c1-ac17-03a09ba6977b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c4c47c985f4f7b9898e2bcec402877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:12Z,use_quota=True,user_id='d5c8cd70c62748f6877cd533402f00a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Creating volume 17178a57-21c2-45c1-ac17-03a09ba6977b {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:12 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:10:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-17178a57-21c2-45c1-ac17-03a09ba6977b 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Attempting download of 74e16fab-69df-4cb3-99da-0b06bc338767 ((None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}])) to volume e3613583-024b-4687-9b81-1478e073e004. {{(pid=83167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 02:10:13 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-17178a57-21c2-45c1-ac17-03a09ba6977b 1073741824 Feb 27 02:10:13 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d5d2ba-5617-4c75-afe3-bee9380676d7]: (4, 'raw') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_3hufphdn {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Flow 'volume_create_manager' (d21d23d7-bc64-40d1-8d4f-09889b839fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07417a6c-ddca-4d15-b7ee-42d8aae66887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07417a6c-ddca-4d15-b7ee-42d8aae66887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1113453643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8fc7122-f6ad-42e5-bcd8-eacca58647ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c4c47c985f4f7b9898e2bcec402877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:13Z,use_quota=True,user_id='d5c8cd70c62748f6877cd533402f00a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ce4608-f0ca-4361-86ae-9f2a9818e800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:13 devstack sudo[89879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_3hufphdn Feb 27 02:10:13 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ce4608-f0ca-4361-86ae-9f2a9818e800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42c2c18c-a244-45a2-8464-7caf374f0394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42c2c18c-a244-45a2-8464-7caf374f0394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8fc7122-f6ad-42e5-bcd8-eacca58647ea', 'volume_name': 'volume-a8fc7122-f6ad-42e5-bcd8-eacca58647ea', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:13 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d9615a8-da2d-4894-86cf-6ab0dd31e93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d9615a8-da2d-4894-86cf-6ab0dd31e93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe9edf3-1b17-4a03-baa6-1c1958cec148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:13 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Volume a8fc7122-f6ad-42e5-bcd8-eacca58647ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8fc7122-f6ad-42e5-bcd8-eacca58647ea', 'volume_size': 1} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9aab5969-7346-4eb9-8e7b-9cecbc331d9b tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-04dab9de-ec02-4ebf-a7ce-e0e56c364057" returned: 0 in 0.706s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9aab5969-7346-4eb9-8e7b-9cecbc331d9b tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-04dab9de-ec02-4ebf-a7ce-e0e56c364057 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:13 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-04dab9de-ec02-4ebf-a7ce-e0e56c364057 Feb 27 02:10:13 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:13 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_3hufphdn" returned: 0 in 0.506s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_3hufphdn {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:13 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-17178a57-21c2-45c1-ac17-03a09ba6977b 1073741824" returned: 0 in 0.606s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-17178a57-21c2-45c1-ac17-03a09ba6977b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:13 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9aab5969-7346-4eb9-8e7b-9cecbc331d9b tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-04dab9de-ec02-4ebf-a7ce-e0e56c364057" returned: 0 in 0.458s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:13 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-17178a57-21c2-45c1-ac17-03a09ba6977b Feb 27 02:10:13 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9aab5969-7346-4eb9-8e7b-9cecbc331d9b tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-04dab9de-ec02-4ebf-a7ce-e0e56c364057" released by "delete_volume" :: held 1.215s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:13 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_3hufphdn Feb 27 02:10:13 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-9aab5969-7346-4eb9-8e7b-9cecbc331d9b tempest-VolumesSnapshotTestJSON-1899760600 None] Created reservations ['73e9a715-af17-4bb0-8fcb-08b128067c06', 'fb3ee6f9-45fe-46d7-ac02-c219a62eb46e', '5be5a931-5dbe-41cf-9fcb-9a6559a38482', 'b9fe7045-286b-48ff-ab90-c48aa9f6a998'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9aab5969-7346-4eb9-8e7b-9cecbc331d9b tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9aab5969-7346-4eb9-8e7b-9cecbc331d9b tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9aab5969-7346-4eb9-8e7b-9cecbc331d9b tempest-VolumesSnapshotTestJSON-1899760600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9aab5969-7346-4eb9-8e7b-9cecbc331d9b tempest-VolumesSnapshotTestJSON-1899760600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9aab5969-7346-4eb9-8e7b-9cecbc331d9b tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9aab5969-7346-4eb9-8e7b-9cecbc331d9b tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:13 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:13 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:14 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-17178a57-21c2-45c1-ac17-03a09ba6977b" returned: 0 in 0.412s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.467s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-397655306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c4c47c985f4f7b9898e2bcec402877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:12Z,use_quota=True,user_id='d5c8cd70c62748f6877cd533402f00a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Creating volume 9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:14 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9c7aadc-3a67-4cf7-a3a7-76f019af5acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17178a57-21c2-45c1-ac17-03a09ba6977b', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:14 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5 1073741824 Feb 27 02:10:14 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:14 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f545112-967e-4f00-9843-ff15c074c37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_3hufphdn" returned: 1 in 0.503s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74e16fab-69df-4cb3-99da-0b06bc338767_3hufphdn' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[766300e1-6e10-4e73-a89b-64acc8489449]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_ewnw0xxldevstack@QuobyteHD {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:14 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Volume volume-17178a57-21c2-45c1-ac17-03a09ba6977b (17178a57-21c2-45c1-ac17-03a09ba6977b): created successfully Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f545112-967e-4f00-9843-ff15c074c37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Flow 'volume_create_manager' (d4bdafad-07fd-48cf-b114-2be20e8a58a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:14 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1f50964e-382a-41ec-a919-286772ae9aff tempest-CreateVolumesFromImageTest-1907861300 None] Created volume successfully. Feb 27 02:10:14 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_ewnw0xxldevstack@QuobyteHD Feb 27 02:10:14 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:14 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9aab5969-7346-4eb9-8e7b-9cecbc331d9b tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.454s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-9aab5969-7346-4eb9-8e7b-9cecbc331d9b tempest-VolumesSnapshotTestJSON-1899760600 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:14 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-9aab5969-7346-4eb9-8e7b-9cecbc331d9b tempest-VolumesSnapshotTestJSON-1899760600 None] Deleted volume successfully. Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9aab5969-7346-4eb9-8e7b-9cecbc331d9b tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-04dab9de-ec02-4ebf-a7ce-e0e56c364057-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-5d89cb15-b248-4810-a362-4420fcfd67f8-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:14 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-5d89cb15-b248-4810-a362-4420fcfd67f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-quobyte-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5 1073741824" returned: 0 in 0.550s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-quobyte-5d89cb15-b248-4810-a362-4420fcfd67f8" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-5d89cb15-b248-4810-a362-4420fcfd67f8" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] Deleting offline snapshot 5d89cb15-b248-4810-a362-4420fcfd67f8 of volume eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] snapshot_file for this snap is: volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:10:14 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_ewnw0xxldevstack@QuobyteHD" returned: 0 in 0.562s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] 74e16fab-69df-4cb3-99da-0b06bc338767 was qcow2, converting to raw {{(pid=83167) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_ewnw0xxldevstack@QuobyteHD /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[104b5712-31a6-4e87-9e8d-9e425c303430]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:14 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_ewnw0xxldevstack@QuobyteHD /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 Feb 27 02:10:14 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:14 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5 Feb 27 02:10:14 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:14 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8 Feb 27 02:10:14 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:15 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5" returned: 0 in 0.535s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:15 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.457s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-390838039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511ef7bb-725b-4a8e-9ffb-e0579a76fc68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c4c47c985f4f7b9898e2bcec402877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:13Z,use_quota=True,user_id='d5c8cd70c62748f6877cd533402f00a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Creating volume 511ef7bb-725b-4a8e-9ffb-e0579a76fc68 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:15 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-511ef7bb-725b-4a8e-9ffb-e0579a76fc68 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8" returned: 0 in 0.584s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:10:15 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-511ef7bb-725b-4a8e-9ffb-e0579a76fc68 1073741824 Feb 27 02:10:15 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de44aaec-ee5f-4777-8a24-fdcb025f9d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01bd7074-c32f-4bf5-a3e7-1dc03d06385a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee06e231-edab-42e8-b78a-b0b3243e55bf]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:15 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Volume volume-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5 (9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5): created successfully Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01bd7074-c32f-4bf5-a3e7-1dc03d06385a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Flow 'volume_create_manager' (a4910046-3a13-4343-92ae-a1cb705338ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:15 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ac7ddac8-9a4a-4084-a9ce-4559cc3a225c tempest-CreateVolumesFromImageTest-1907861300 None] Created volume successfully. Feb 27 02:10:15 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b Feb 27 02:10:15 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:15 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_ewnw0xxldevstack@QuobyteHD /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004" returned: 0 in 0.905s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_74e16fab-69df-4cb3-99da-0b06bc338767_ewnw0xxldevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:10:15 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Converted 112.00 MB image at 112.00 MB/s Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:15 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 1G Feb 27 02:10:15 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:15 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b" returned: 0 in 0.577s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:15 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-511ef7bb-725b-4a8e-9ffb-e0579a76fc68 1073741824" returned: 0 in 0.654s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:15 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8 Feb 27 02:10:15 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-511ef7bb-725b-4a8e-9ffb-e0579a76fc68 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:15 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-511ef7bb-725b-4a8e-9ffb-e0579a76fc68 Feb 27 02:10:15 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:16 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 1G" returned: 0 in 0.517s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dedb298-e753-47e2-9ab2-c76e33ef9997]: (4, 'raw') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:16 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 Feb 27 02:10:16 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:16 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-511ef7bb-725b-4a8e-9ffb-e0579a76fc68" returned: 0 in 0.413s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.367s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-133000890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e61fbba-6fee-453f-97d2-13341c67c9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c4c47c985f4f7b9898e2bcec402877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:13Z,use_quota=True,user_id='d5c8cd70c62748f6877cd533402f00a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Creating volume 4e61fbba-6fee-453f-97d2-13341c67c9f8 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:16 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4e61fbba-6fee-453f-97d2-13341c67c9f8 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475b4e19-473a-4fd7-acc7-e723d33d887b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-511ef7bb-725b-4a8e-9ffb-e0579a76fc68', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afe0906-a483-4b3c-8b9c-54335068f771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:16 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Volume volume-511ef7bb-725b-4a8e-9ffb-e0579a76fc68 (511ef7bb-725b-4a8e-9ffb-e0579a76fc68): created successfully Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afe0906-a483-4b3c-8b9c-54335068f771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:16 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4e61fbba-6fee-453f-97d2-13341c67c9f8 1073741824 Feb 27 02:10:16 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Flow 'volume_create_manager' (d97a24c1-9fcb-46c1-9084-ff506ce413a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:16 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-5e3afd35-95ba-4e58-8918-f27d0d3e0064 tempest-CreateVolumesFromImageTest-1907861300 None] Created volume successfully. Feb 27 02:10:16 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8" returned: 0 in 0.608s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:16 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8 Feb 27 02:10:16 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:16 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004" returned: 0 in 0.595s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:16 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 Feb 27 02:10:16 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:16 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4e61fbba-6fee-453f-97d2-13341c67c9f8 1073741824" returned: 0 in 0.524s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4e61fbba-6fee-453f-97d2-13341c67c9f8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:16 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4e61fbba-6fee-453f-97d2-13341c67c9f8 Feb 27 02:10:16 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:16 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b.5d89cb15-b248-4810-a362-4420fcfd67f8" returned: 0 in 0.473s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-5d89cb15-b248-4810-a362-4420fcfd67f8" released by "_delete_snapshot" :: held 2.355s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b" released by "delete_snapshot" :: held 2.369s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] Created reservations ['23cbe84b-1db0-48aa-96d5-322f0fc3b980', 'da32067d-d117-43d2-b151-686212f03f11', '351a7a0b-e2dc-47de-9991-42f7440b8641', '9b82872d-c809-46db-b0f9-bf9cf41e4e64'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:17 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] Delete snapshot completed successfully. Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-26355a04-1cd3-40af-a8a8-49c044aad18a tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-5d89cb15-b248-4810-a362-4420fcfd67f8-delete_snapshot" released by "delete_snapshot" :: held 2.463s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:17 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004" returned: 1 in 0.550s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Downloaded image 74e16fab-69df-4cb3-99da-0b06bc338767 ((None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}])) to volume e3613583-024b-4687-9b81-1478e073e004 successfully. {{(pid=83167) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Temporary image 74e16fab-69df-4cb3-99da-0b06bc338767 for user 983ac70ab90f4b01b9765356a9588944 is deleted. {{(pid=83167) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.volume_utils [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Marking volume e3613583-024b-4687-9b81-1478e073e004 as bootable. {{(pid=83167) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Copying metadata from image 74e16fab-69df-4cb3-99da-0b06bc338767 to e3613583-024b-4687-9b81-1478e073e004. {{(pid=83167) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Creating volume glance metadata for volume e3613583-024b-4687-9b81-1478e073e004 backed by image 74e16fab-69df-4cb3-99da-0b06bc338767 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83167) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453abf77-c563-48db-a43e-8032e445f1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3613583-024b-4687-9b81-1478e073e004', 'volume_size': 1, 'image_id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74e16fab-69df-4cb3-99da-0b06bc338767', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8c3ebea7eea44d62b013a3b663b3a45d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '74e16fab-69df-4cb3-99da-0b06bc338767', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 57, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74e16fab-69df-4cb3-99da-0b06bc338767/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ba696b-9007-4cf5-ba7a-acfed313d18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:17 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Volume volume-e3613583-024b-4687-9b81-1478e073e004 (e3613583-024b-4687-9b81-1478e073e004): created successfully Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ba696b-9007-4cf5-ba7a-acfed313d18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Flow 'volume_create_manager' (2e5dd57f-0536-4a5c-bc5e-ac82da1c9578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:17 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-95a2fa09-600a-444b-8390-1ed3ff2d84fe tempest-VolumesGetTest-224619659 None] Created volume successfully. Feb 27 02:10:17 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4e61fbba-6fee-453f-97d2-13341c67c9f8" returned: 0 in 0.491s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.212s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1113453643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8fc7122-f6ad-42e5-bcd8-eacca58647ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c4c47c985f4f7b9898e2bcec402877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:13Z,use_quota=True,user_id='d5c8cd70c62748f6877cd533402f00a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Creating volume a8fc7122-f6ad-42e5-bcd8-eacca58647ea {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:17 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a8fc7122-f6ad-42e5-bcd8-eacca58647ea 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:17 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a8fc7122-f6ad-42e5-bcd8-eacca58647ea 1073741824 Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0d281b8-afe7-4a1b-80bb-78416e508a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e61fbba-6fee-453f-97d2-13341c67c9f8', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:17 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7dc17a-9f2a-47e8-ac57-8630fb2972bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:17 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Volume volume-4e61fbba-6fee-453f-97d2-13341c67c9f8 (4e61fbba-6fee-453f-97d2-13341c67c9f8): created successfully Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7dc17a-9f2a-47e8-ac57-8630fb2972bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Flow 'volume_create_manager' (6e0fafe1-f5d9-467c-afe7-db5bff127ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:17 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c74b4df9-07c2-43b8-90fd-fb68c58bb369 tempest-CreateVolumesFromImageTest-1907861300 None] Created volume successfully. Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-abb3038c-e834-493f-b5c4-82c077596ad8 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-abb3038c-e834-493f-b5c4-82c077596ad8 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-abb3038c-e834-493f-b5c4-82c077596ad8 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-quobyte-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-abb3038c-e834-493f-b5c4-82c077596ad8 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6594baf7-6254-4a8a-881e-82e797d056dc]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-abb3038c-e834-493f-b5c4-82c077596ad8 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:17 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a8fc7122-f6ad-42e5-bcd8-eacca58647ea 1073741824" returned: 0 in 0.524s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:17 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b Feb 27 02:10:17 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a8fc7122-f6ad-42e5-bcd8-eacca58647ea {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:17 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a8fc7122-f6ad-42e5-bcd8-eacca58647ea Feb 27 02:10:17 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:18 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a8fc7122-f6ad-42e5-bcd8-eacca58647ea" returned: 0 in 0.467s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe9edf3-1b17-4a03-baa6-1c1958cec148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8fc7122-f6ad-42e5-bcd8-eacca58647ea', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47dd177-2f6b-4aa6-a8f9-d7b7610a35a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:18 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Volume volume-a8fc7122-f6ad-42e5-bcd8-eacca58647ea (a8fc7122-f6ad-42e5-bcd8-eacca58647ea): created successfully Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47dd177-2f6b-4aa6-a8f9-d7b7610a35a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Flow 'volume_create_manager' (d21d23d7-bc64-40d1-8d4f-09889b839fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:18 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7a0a30ee-1123-45c4-9a5e-81ab6b5a9c46 tempest-CreateVolumesFromImageTest-1907861300 None] Created volume successfully. Feb 27 02:10:18 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-abb3038c-e834-493f-b5c4-82c077596ad8 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b" returned: 0 in 0.628s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-abb3038c-e834-493f-b5c4-82c077596ad8 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:18 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b Feb 27 02:10:18 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Flow 'volume_create_manager' (6c7edbf7-f2ee-43dd-b2c6-96ea74357272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210eaaa8-0b2e-49b0-8c5c-d04dd1ed3e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210eaaa8-0b2e-49b0-8c5c-d04dd1ed3e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1534772621',display_name='tempest-VolumesGetTest-Volume-1507687289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b88cd334c184fe4840951b76f36dfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:19Z,use_quota=True,user_id='983ac70ab90f4b01b9765356a9588944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3969d0a-52b3-4661-bfdb-adc52a58e916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3969d0a-52b3-4661-bfdb-adc52a58e916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9022021a-0093-434f-b3a0-517778ea4b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9022021a-0093-434f-b3a0-517778ea4b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3', 'volume_name': 'volume-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5717e374-bf71-43aa-b34f-f19b197dfe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5717e374-bf71-43aa-b34f-f19b197dfe46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada948f6-0fd8-405b-b6cc-d85f42c20c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:18 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Volume a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3', 'volume_size': 1} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1534772621',display_name='tempest-VolumesGetTest-Volume-1507687289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b88cd334c184fe4840951b76f36dfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:19Z,use_quota=True,user_id='983ac70ab90f4b01b9765356a9588944',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Creating volume a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:18 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ae58bd40-1bdb-4b99-b4fe-de1297cd6386 tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "cinder-a8fc7122-f6ad-42e5-bcd8-eacca58647ea-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:18 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3 1073741824 Feb 27 02:10:18 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ae58bd40-1bdb-4b99-b4fe-de1297cd6386 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "cinder-a8fc7122-f6ad-42e5-bcd8-eacca58647ea-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ae58bd40-1bdb-4b99-b4fe-de1297cd6386 tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "cinder-quobyte-a8fc7122-f6ad-42e5-bcd8-eacca58647ea" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ae58bd40-1bdb-4b99-b4fe-de1297cd6386 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "cinder-quobyte-a8fc7122-f6ad-42e5-bcd8-eacca58647ea" acquired by "delete_volume" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4111209c-b27b-4cb7-bbd2-c4b8b3b3bea3]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ae58bd40-1bdb-4b99-b4fe-de1297cd6386 tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a8fc7122-f6ad-42e5-bcd8-eacca58647ea {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:18 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a8fc7122-f6ad-42e5-bcd8-eacca58647ea Feb 27 02:10:18 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:18 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-abb3038c-e834-493f-b5c4-82c077596ad8 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b" returned: 0 in 0.524s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-abb3038c-e834-493f-b5c4-82c077596ad8 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b" released by "delete_volume" :: held 1.189s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-abb3038c-e834-493f-b5c4-82c077596ad8 tempest-VolumesSnapshotTestJSON-1899760600 None] Created reservations ['9e6c0a7f-59b6-4d71-9d3e-7893e4816eee', '73717013-84f4-46b7-86aa-dbd7812bb1a3', '7529079e-321f-4f5c-bfdd-75b7f6a918d9', '018441a2-da25-480b-b323-dbadfcde5476'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-abb3038c-e834-493f-b5c4-82c077596ad8 tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-abb3038c-e834-493f-b5c4-82c077596ad8 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-abb3038c-e834-493f-b5c4-82c077596ad8 tempest-VolumesSnapshotTestJSON-1899760600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-abb3038c-e834-493f-b5c4-82c077596ad8 tempest-VolumesSnapshotTestJSON-1899760600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-abb3038c-e834-493f-b5c4-82c077596ad8 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-abb3038c-e834-493f-b5c4-82c077596ad8 tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:19 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:19 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:19 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3 1073741824" returned: 0 in 0.571s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:19 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3 Feb 27 02:10:19 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:19 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ae58bd40-1bdb-4b99-b4fe-de1297cd6386 tempest-CreateVolumesFromImageTest-1907861300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a8fc7122-f6ad-42e5-bcd8-eacca58647ea" returned: 0 in 0.651s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ae58bd40-1bdb-4b99-b4fe-de1297cd6386 tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a8fc7122-f6ad-42e5-bcd8-eacca58647ea {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:19 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a8fc7122-f6ad-42e5-bcd8-eacca58647ea Feb 27 02:10:19 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:19 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-abb3038c-e834-493f-b5c4-82c077596ad8 tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.562s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-abb3038c-e834-493f-b5c4-82c077596ad8 tempest-VolumesSnapshotTestJSON-1899760600 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:19 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-abb3038c-e834-493f-b5c4-82c077596ad8 tempest-VolumesSnapshotTestJSON-1899760600 None] Deleted volume successfully. Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-abb3038c-e834-493f-b5c4-82c077596ad8 tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-eea5e2ee-3d13-4c4d-8a41-7a2cd06ebb6b-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:19 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3" returned: 0 in 0.517s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada948f6-0fd8-405b-b6cc-d85f42c20c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b6d35a-b5aa-4012-8642-2c2c4757cdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:19 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Volume volume-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3 (a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3): created successfully Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b6d35a-b5aa-4012-8642-2c2c4757cdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Flow 'volume_create_manager' (6c7edbf7-f2ee-43dd-b2c6-96ea74357272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:19 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b2e304c9-d9d0-4d68-9c32-abd5e0baf97e tempest-VolumesGetTest-224619659 None] Created volume successfully. Feb 27 02:10:19 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ae58bd40-1bdb-4b99-b4fe-de1297cd6386 tempest-CreateVolumesFromImageTest-1907861300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a8fc7122-f6ad-42e5-bcd8-eacca58647ea" returned: 0 in 0.470s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ae58bd40-1bdb-4b99-b4fe-de1297cd6386 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "cinder-quobyte-a8fc7122-f6ad-42e5-bcd8-eacca58647ea" released by "delete_volume" :: held 1.155s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3bb9a1b1-c814-40be-bd61-11c2e6ea50df tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-59bf9c4a-0fad-4157-86e3-577aafe92c4e-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ae58bd40-1bdb-4b99-b4fe-de1297cd6386 tempest-CreateVolumesFromImageTest-1907861300 None] Created reservations ['ffc04480-0499-40f8-bb6e-261908f6fee3', 'aaeb5210-9f65-4702-ab3f-33c72cd7ad8f', '82abf07b-bcdd-4a5e-995f-5556e2805bd0', 'cb719fc7-b61b-4fb1-b148-e1ab4b6d360d'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3bb9a1b1-c814-40be-bd61-11c2e6ea50df tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-59bf9c4a-0fad-4157-86e3-577aafe92c4e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3bb9a1b1-c814-40be-bd61-11c2e6ea50df tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "cinder-quobyte-59bf9c4a-0fad-4157-86e3-577aafe92c4e" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3bb9a1b1-c814-40be-bd61-11c2e6ea50df tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-59bf9c4a-0fad-4157-86e3-577aafe92c4e" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d86740d-494c-4c56-a82f-5e6fb3c0f063]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3bb9a1b1-c814-40be-bd61-11c2e6ea50df tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ae58bd40-1bdb-4b99-b4fe-de1297cd6386 tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ae58bd40-1bdb-4b99-b4fe-de1297cd6386 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ae58bd40-1bdb-4b99-b4fe-de1297cd6386 tempest-CreateVolumesFromImageTest-1907861300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ae58bd40-1bdb-4b99-b4fe-de1297cd6386 tempest-CreateVolumesFromImageTest-1907861300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ae58bd40-1bdb-4b99-b4fe-de1297cd6386 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ae58bd40-1bdb-4b99-b4fe-de1297cd6386 tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:20 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:20 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:20 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e Feb 27 02:10:20 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:20 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3bb9a1b1-c814-40be-bd61-11c2e6ea50df tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e" returned: 0 in 0.457s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3bb9a1b1-c814-40be-bd61-11c2e6ea50df tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:20 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e Feb 27 02:10:20 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:20 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ae58bd40-1bdb-4b99-b4fe-de1297cd6386 tempest-CreateVolumesFromImageTest-1907861300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.539s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-ae58bd40-1bdb-4b99-b4fe-de1297cd6386 tempest-CreateVolumesFromImageTest-1907861300 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:20 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ae58bd40-1bdb-4b99-b4fe-de1297cd6386 tempest-CreateVolumesFromImageTest-1907861300 None] Deleted volume successfully. Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ae58bd40-1bdb-4b99-b4fe-de1297cd6386 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "cinder-a8fc7122-f6ad-42e5-bcd8-eacca58647ea-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0d148d66-3100-41ee-bf46-710c4373a8c6 tempest-VolumesGetTest-224619659 None] Acquiring lock "cinder-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0d148d66-3100-41ee-bf46-710c4373a8c6 tempest-VolumesGetTest-224619659 None] Lock "cinder-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0d148d66-3100-41ee-bf46-710c4373a8c6 tempest-VolumesGetTest-224619659 None] Acquiring lock "cinder-quobyte-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-86e6c877-f6d4-41b7-8210-b766367ca456 tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "cinder-4e61fbba-6fee-453f-97d2-13341c67c9f8-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0d148d66-3100-41ee-bf46-710c4373a8c6 tempest-VolumesGetTest-224619659 None] Lock "cinder-quobyte-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3" acquired by "delete_volume" :: waited 0.028s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-86e6c877-f6d4-41b7-8210-b766367ca456 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "cinder-4e61fbba-6fee-453f-97d2-13341c67c9f8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a456c90b-f3ed-4154-a4a5-39dd9bccf874]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0d148d66-3100-41ee-bf46-710c4373a8c6 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-86e6c877-f6d4-41b7-8210-b766367ca456 tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "cinder-quobyte-4e61fbba-6fee-453f-97d2-13341c67c9f8" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-86e6c877-f6d4-41b7-8210-b766367ca456 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "cinder-quobyte-4e61fbba-6fee-453f-97d2-13341c67c9f8" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:21 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[87362ffc-e94a-4675-869e-061bb720c0db]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-86e6c877-f6d4-41b7-8210-b766367ca456 tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4e61fbba-6fee-453f-97d2-13341c67c9f8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:21 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3 Feb 27 02:10:21 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:21 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3bb9a1b1-c814-40be-bd61-11c2e6ea50df tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-59bf9c4a-0fad-4157-86e3-577aafe92c4e" returned: 0 in 0.498s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:21 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4e61fbba-6fee-453f-97d2-13341c67c9f8 Feb 27 02:10:21 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3bb9a1b1-c814-40be-bd61-11c2e6ea50df tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-quobyte-59bf9c4a-0fad-4157-86e3-577aafe92c4e" released by "delete_volume" :: held 0.991s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:21 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-3bb9a1b1-c814-40be-bd61-11c2e6ea50df tempest-VolumesSnapshotTestJSON-1899760600 None] Created reservations ['3a315759-ee28-4873-8802-3f7a7962111c', '215426ec-37c0-432b-80cc-687508ecdaa1', '3365d019-bbdc-4e2c-8ba5-3dd4a12b337b', 'db210f85-c8c1-4767-8431-723a5c631577'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3bb9a1b1-c814-40be-bd61-11c2e6ea50df tempest-VolumesSnapshotTestJSON-1899760600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3bb9a1b1-c814-40be-bd61-11c2e6ea50df tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3bb9a1b1-c814-40be-bd61-11c2e6ea50df tempest-VolumesSnapshotTestJSON-1899760600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-3bb9a1b1-c814-40be-bd61-11c2e6ea50df tempest-VolumesSnapshotTestJSON-1899760600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-3bb9a1b1-c814-40be-bd61-11c2e6ea50df tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3bb9a1b1-c814-40be-bd61-11c2e6ea50df tempest-VolumesSnapshotTestJSON-1899760600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:21 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:21 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:21 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0d148d66-3100-41ee-bf46-710c4373a8c6 tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3" returned: 0 in 0.562s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0d148d66-3100-41ee-bf46-710c4373a8c6 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:21 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3 Feb 27 02:10:21 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:21 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-86e6c877-f6d4-41b7-8210-b766367ca456 tempest-CreateVolumesFromImageTest-1907861300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4e61fbba-6fee-453f-97d2-13341c67c9f8" returned: 0 in 0.578s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-86e6c877-f6d4-41b7-8210-b766367ca456 tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4e61fbba-6fee-453f-97d2-13341c67c9f8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:21 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4e61fbba-6fee-453f-97d2-13341c67c9f8 Feb 27 02:10:21 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:21 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-3bb9a1b1-c814-40be-bd61-11c2e6ea50df tempest-VolumesSnapshotTestJSON-1899760600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.461s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:21 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-3bb9a1b1-c814-40be-bd61-11c2e6ea50df tempest-VolumesSnapshotTestJSON-1899760600 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:21 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-3bb9a1b1-c814-40be-bd61-11c2e6ea50df tempest-VolumesSnapshotTestJSON-1899760600 None] Deleted volume successfully. Feb 27 02:10:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-3bb9a1b1-c814-40be-bd61-11c2e6ea50df tempest-VolumesSnapshotTestJSON-1899760600 None] Lock "cinder-59bf9c4a-0fad-4157-86e3-577aafe92c4e-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:22 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0d148d66-3100-41ee-bf46-710c4373a8c6 tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3" returned: 0 in 0.539s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0d148d66-3100-41ee-bf46-710c4373a8c6 tempest-VolumesGetTest-224619659 None] Lock "cinder-quobyte-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3" released by "delete_volume" :: held 1.144s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:22 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-86e6c877-f6d4-41b7-8210-b766367ca456 tempest-CreateVolumesFromImageTest-1907861300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-4e61fbba-6fee-453f-97d2-13341c67c9f8" returned: 0 in 0.487s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-86e6c877-f6d4-41b7-8210-b766367ca456 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "cinder-quobyte-4e61fbba-6fee-453f-97d2-13341c67c9f8" released by "delete_volume" :: held 1.089s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-0d148d66-3100-41ee-bf46-710c4373a8c6 tempest-VolumesGetTest-224619659 None] Created reservations ['0ce94013-04ac-46f1-863a-2ecdcb566732', '82b0dc3f-016a-4c29-9368-6effef04d536', '5e0e13d8-888b-4bf5-98ed-fcff82f9dc51', '33b59791-a917-43bc-a42f-b78da5d58b75'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-86e6c877-f6d4-41b7-8210-b766367ca456 tempest-CreateVolumesFromImageTest-1907861300 None] Created reservations ['0ff44348-34f5-4a18-8200-c59f39f2a32e', '0eb027b4-ba4b-4ced-abbb-2d5652aa1913', '7a9fa7f0-502a-4618-9059-da26d435ea6c', '50fcbd09-1310-4618-952a-8d696187baeb'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0d148d66-3100-41ee-bf46-710c4373a8c6 tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0d148d66-3100-41ee-bf46-710c4373a8c6 tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0d148d66-3100-41ee-bf46-710c4373a8c6 tempest-VolumesGetTest-224619659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0d148d66-3100-41ee-bf46-710c4373a8c6 tempest-VolumesGetTest-224619659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0d148d66-3100-41ee-bf46-710c4373a8c6 tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0d148d66-3100-41ee-bf46-710c4373a8c6 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:22 devstack sudo[90048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:22 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-86e6c877-f6d4-41b7-8210-b766367ca456 tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-86e6c877-f6d4-41b7-8210-b766367ca456 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-86e6c877-f6d4-41b7-8210-b766367ca456 tempest-CreateVolumesFromImageTest-1907861300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-86e6c877-f6d4-41b7-8210-b766367ca456 tempest-CreateVolumesFromImageTest-1907861300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-86e6c877-f6d4-41b7-8210-b766367ca456 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-86e6c877-f6d4-41b7-8210-b766367ca456 tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:22 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:22 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:22 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0d148d66-3100-41ee-bf46-710c4373a8c6 tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.456s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-0d148d66-3100-41ee-bf46-710c4373a8c6 tempest-VolumesGetTest-224619659 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:22 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-0d148d66-3100-41ee-bf46-710c4373a8c6 tempest-VolumesGetTest-224619659 None] Deleted volume successfully. Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0d148d66-3100-41ee-bf46-710c4373a8c6 tempest-VolumesGetTest-224619659 None] Lock "cinder-a7396a5b-728e-4b4b-bcb6-6f22fff0e7c3-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:22 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-86e6c877-f6d4-41b7-8210-b766367ca456 tempest-CreateVolumesFromImageTest-1907861300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.670s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-86e6c877-f6d4-41b7-8210-b766367ca456 tempest-CreateVolumesFromImageTest-1907861300 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:22 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-86e6c877-f6d4-41b7-8210-b766367ca456 tempest-CreateVolumesFromImageTest-1907861300 None] Deleted volume successfully. Feb 27 02:10:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-86e6c877-f6d4-41b7-8210-b766367ca456 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "cinder-4e61fbba-6fee-453f-97d2-13341c67c9f8-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2a35f656-fb72-43de-a760-76d0ec3f3490 tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "cinder-511ef7bb-725b-4a8e-9ffb-e0579a76fc68-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] Acquiring lock "cinder-e3613583-024b-4687-9b81-1478e073e004-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2a35f656-fb72-43de-a760-76d0ec3f3490 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "cinder-511ef7bb-725b-4a8e-9ffb-e0579a76fc68-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] Lock "cinder-e3613583-024b-4687-9b81-1478e073e004-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2a35f656-fb72-43de-a760-76d0ec3f3490 tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "cinder-quobyte-511ef7bb-725b-4a8e-9ffb-e0579a76fc68" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2a35f656-fb72-43de-a760-76d0ec3f3490 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "cinder-quobyte-511ef7bb-725b-4a8e-9ffb-e0579a76fc68" acquired by "delete_volume" :: waited 0.024s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] Acquiring lock "cinder-quobyte-e3613583-024b-4687-9b81-1478e073e004" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] Lock "cinder-quobyte-e3613583-024b-4687-9b81-1478e073e004" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:23 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3a07c2-827b-4d01-9518-528f88ced78e]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2a35f656-fb72-43de-a760-76d0ec3f3490 tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-511ef7bb-725b-4a8e-9ffb-e0579a76fc68 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:23 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66796d2-82fb-4239-bbf4-f3d9dc122a08]: (4, 'raw') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:23 devstack sudo[90055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 Feb 27 02:10:23 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:23 devstack sudo[90054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-511ef7bb-725b-4a8e-9ffb-e0579a76fc68 Feb 27 02:10:23 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:23 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004" returned: 0 in 0.606s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:24 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 Feb 27 02:10:24 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:24 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2a35f656-fb72-43de-a760-76d0ec3f3490 tempest-CreateVolumesFromImageTest-1907861300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-511ef7bb-725b-4a8e-9ffb-e0579a76fc68" returned: 0 in 0.799s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2a35f656-fb72-43de-a760-76d0ec3f3490 tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-511ef7bb-725b-4a8e-9ffb-e0579a76fc68 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:24 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-511ef7bb-725b-4a8e-9ffb-e0579a76fc68 Feb 27 02:10:24 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:24 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004" returned: 1 in 0.738s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004' failed. Not Retrying. {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:24 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2a35f656-fb72-43de-a760-76d0ec3f3490 tempest-CreateVolumesFromImageTest-1907861300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-511ef7bb-725b-4a8e-9ffb-e0579a76fc68" returned: 0 in 0.592s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:24 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004 Feb 27 02:10:24 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:24 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2a35f656-fb72-43de-a760-76d0ec3f3490 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "cinder-quobyte-511ef7bb-725b-4a8e-9ffb-e0579a76fc68" released by "delete_volume" :: held 1.448s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:24 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-2a35f656-fb72-43de-a760-76d0ec3f3490 tempest-CreateVolumesFromImageTest-1907861300 None] Created reservations ['201d2bc8-8783-4763-9e0d-953ffd21d40d', 'f9cc6150-22ec-4d93-803c-7d9f77b7631d', 'fc54f008-fa1e-4467-a9c4-a4b291131406', '19f316bb-39ef-470a-ad00-8abb7102d27f'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2a35f656-fb72-43de-a760-76d0ec3f3490 tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2a35f656-fb72-43de-a760-76d0ec3f3490 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2a35f656-fb72-43de-a760-76d0ec3f3490 tempest-CreateVolumesFromImageTest-1907861300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2a35f656-fb72-43de-a760-76d0ec3f3490 tempest-CreateVolumesFromImageTest-1907861300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2a35f656-fb72-43de-a760-76d0ec3f3490 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2a35f656-fb72-43de-a760-76d0ec3f3490 tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:24 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:24 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:25 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e3613583-024b-4687-9b81-1478e073e004" returned: 0 in 0.562s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] Lock "cinder-quobyte-e3613583-024b-4687-9b81-1478e073e004" released by "delete_volume" :: held 1.962s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:25 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] Created reservations ['e93dea90-7555-499c-a05a-7061d72fcb51', 'f5a2400d-4463-4910-93a6-c934da05f07b', '872f01c2-406c-4b4c-9a40-707b39b75462', '9b92d1d2-5cfb-46d9-bd87-b72eb805f06b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:25 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2a35f656-fb72-43de-a760-76d0ec3f3490 tempest-CreateVolumesFromImageTest-1907861300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.531s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:25 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-2a35f656-fb72-43de-a760-76d0ec3f3490 tempest-CreateVolumesFromImageTest-1907861300 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:25 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2a35f656-fb72-43de-a760-76d0ec3f3490 tempest-CreateVolumesFromImageTest-1907861300 None] Deleted volume successfully. Feb 27 02:10:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2a35f656-fb72-43de-a760-76d0ec3f3490 tempest-CreateVolumesFromImageTest-1907861300 None] Lock "cinder-511ef7bb-725b-4a8e-9ffb-e0579a76fc68-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:25 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:25 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:25 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e310449f-4bac-4c6e-b107-0e95f2bfed2e tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "cinder-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e310449f-4bac-4c6e-b107-0e95f2bfed2e tempest-CreateVolumesFromImageTest-1907861300 None] Lock "cinder-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e310449f-4bac-4c6e-b107-0e95f2bfed2e tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "cinder-quobyte-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e310449f-4bac-4c6e-b107-0e95f2bfed2e tempest-CreateVolumesFromImageTest-1907861300 None] Lock "cinder-quobyte-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:25 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0834310a-093a-42af-979f-fba49edc3524]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e310449f-4bac-4c6e-b107-0e95f2bfed2e tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:25 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5 Feb 27 02:10:25 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:26 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.613s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:26 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:26 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] Deleted volume successfully. Feb 27 02:10:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-47295fc3-fa5f-469c-afcc-e8f1aa36b553 tempest-VolumesGetTest-224619659 None] Lock "cinder-e3613583-024b-4687-9b81-1478e073e004-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:26 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e310449f-4bac-4c6e-b107-0e95f2bfed2e tempest-CreateVolumesFromImageTest-1907861300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5" returned: 0 in 0.753s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e310449f-4bac-4c6e-b107-0e95f2bfed2e tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:26 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5 Feb 27 02:10:26 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:26 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e310449f-4bac-4c6e-b107-0e95f2bfed2e tempest-CreateVolumesFromImageTest-1907861300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5" returned: 0 in 0.580s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e310449f-4bac-4c6e-b107-0e95f2bfed2e tempest-CreateVolumesFromImageTest-1907861300 None] Lock "cinder-quobyte-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5" released by "delete_volume" :: held 1.366s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:26 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-e310449f-4bac-4c6e-b107-0e95f2bfed2e tempest-CreateVolumesFromImageTest-1907861300 None] Created reservations ['0faa45db-3725-446d-85ab-52564b42b1e3', 'e4904a2e-4817-4e17-95e9-72364980f5c0', 'e2fbfeca-9097-4e7e-8c10-5e0149a839b5', 'de3e09c9-7042-40ab-8659-539179ec7b58'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e310449f-4bac-4c6e-b107-0e95f2bfed2e tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e310449f-4bac-4c6e-b107-0e95f2bfed2e tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e310449f-4bac-4c6e-b107-0e95f2bfed2e tempest-CreateVolumesFromImageTest-1907861300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e310449f-4bac-4c6e-b107-0e95f2bfed2e tempest-CreateVolumesFromImageTest-1907861300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e310449f-4bac-4c6e-b107-0e95f2bfed2e tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e310449f-4bac-4c6e-b107-0e95f2bfed2e tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:27 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:27 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:27 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e310449f-4bac-4c6e-b107-0e95f2bfed2e tempest-CreateVolumesFromImageTest-1907861300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.571s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-e310449f-4bac-4c6e-b107-0e95f2bfed2e tempest-CreateVolumesFromImageTest-1907861300 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:27 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e310449f-4bac-4c6e-b107-0e95f2bfed2e tempest-CreateVolumesFromImageTest-1907861300 None] Deleted volume successfully. Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e310449f-4bac-4c6e-b107-0e95f2bfed2e tempest-CreateVolumesFromImageTest-1907861300 None] Lock "cinder-9eef5aee-8fa6-4f28-bcd6-5fcc4f10baf5-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d140b166-d130-4c96-9afb-d072f806bb8f tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "cinder-17178a57-21c2-45c1-ac17-03a09ba6977b-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d140b166-d130-4c96-9afb-d072f806bb8f tempest-CreateVolumesFromImageTest-1907861300 None] Lock "cinder-17178a57-21c2-45c1-ac17-03a09ba6977b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d140b166-d130-4c96-9afb-d072f806bb8f tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "cinder-quobyte-17178a57-21c2-45c1-ac17-03a09ba6977b" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d140b166-d130-4c96-9afb-d072f806bb8f tempest-CreateVolumesFromImageTest-1907861300 None] Lock "cinder-quobyte-17178a57-21c2-45c1-ac17-03a09ba6977b" acquired by "delete_volume" :: waited 0.033s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Flow 'volume_create_manager' (91a5ac32-aaa2-43c2-bb5d-7adae9ae23d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f62fd7-2741-42fd-b821-10ab6d122ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be86078-10cc-4f59-9f38-a35b35a61f0f]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f62fd7-2741-42fd-b821-10ab6d122ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-255748069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca91730b-96e4-4409-870c-cd289bb70cc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9c48caada741d2b6b26efb98167317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:28Z,use_quota=True,user_id='e53fe6825a3745c586e330f9a3e70035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (332a5014-4298-4caf-9f69-c4d6223ad0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (332a5014-4298-4caf-9f69-c4d6223ad0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbef8568-5c1c-405c-a97b-5ee4283352d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbef8568-5c1c-405c-a97b-5ee4283352d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca91730b-96e4-4409-870c-cd289bb70cc7', 'volume_name': 'volume-ca91730b-96e4-4409-870c-cd289bb70cc7', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a4b854-fda9-4927-b083-816cd1464549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a4b854-fda9-4927-b083-816cd1464549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b9fca1-b7c5-4472-b35d-81614055940e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:27 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Volume ca91730b-96e4-4409-870c-cd289bb70cc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca91730b-96e4-4409-870c-cd289bb70cc7', 'volume_size': 1} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-255748069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca91730b-96e4-4409-870c-cd289bb70cc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9c48caada741d2b6b26efb98167317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:28Z,use_quota=True,user_id='e53fe6825a3745c586e330f9a3e70035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Creating volume ca91730b-96e4-4409-870c-cd289bb70cc7 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:27 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d140b166-d130-4c96-9afb-d072f806bb8f tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-17178a57-21c2-45c1-ac17-03a09ba6977b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:27 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7 1073741824 Feb 27 02:10:27 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:28 devstack sudo[90096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-17178a57-21c2-45c1-ac17-03a09ba6977b Feb 27 02:10:28 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:28 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:28 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d140b166-d130-4c96-9afb-d072f806bb8f tempest-CreateVolumesFromImageTest-1907861300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-17178a57-21c2-45c1-ac17-03a09ba6977b" returned: 0 in 0.595s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d140b166-d130-4c96-9afb-d072f806bb8f tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-17178a57-21c2-45c1-ac17-03a09ba6977b {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7 1073741824" returned: 0 in 0.617s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:28 devstack sudo[90105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-17178a57-21c2-45c1-ac17-03a09ba6977b Feb 27 02:10:28 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:28 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7 Feb 27 02:10:28 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:29 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d140b166-d130-4c96-9afb-d072f806bb8f tempest-CreateVolumesFromImageTest-1907861300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-17178a57-21c2-45c1-ac17-03a09ba6977b" returned: 0 in 0.546s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d140b166-d130-4c96-9afb-d072f806bb8f tempest-CreateVolumesFromImageTest-1907861300 None] Lock "cinder-quobyte-17178a57-21c2-45c1-ac17-03a09ba6977b" released by "delete_volume" :: held 1.248s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:29 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-d140b166-d130-4c96-9afb-d072f806bb8f tempest-CreateVolumesFromImageTest-1907861300 None] Created reservations ['e2c69821-6ccb-4e9a-a091-03f66469c3b7', '3e48fcfd-ce99-4e6f-8402-d6072b286745', '9f4129e3-2ecc-4ab9-80a1-ebc0ac672f69', '7a525c9d-1186-4a9a-8c84-d1895f0775c8'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:29 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7" returned: 0 in 0.588s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b9fca1-b7c5-4472-b35d-81614055940e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca91730b-96e4-4409-870c-cd289bb70cc7', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc1c979-718f-43f3-ba55-c3530b43ef13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:29 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Volume volume-ca91730b-96e4-4409-870c-cd289bb70cc7 (ca91730b-96e4-4409-870c-cd289bb70cc7): created successfully Feb 27 02:10:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc1c979-718f-43f3-ba55-c3530b43ef13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Flow 'volume_create_manager' (91a5ac32-aaa2-43c2-bb5d-7adae9ae23d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:29 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2c21849c-7f15-4094-9bc2-e1e37a19e6c5 tempest-CreateVolumesFromSnapshotTest-596258211 None] Created volume successfully. Feb 27 02:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d140b166-d130-4c96-9afb-d072f806bb8f tempest-CreateVolumesFromImageTest-1907861300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d140b166-d130-4c96-9afb-d072f806bb8f tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d140b166-d130-4c96-9afb-d072f806bb8f tempest-CreateVolumesFromImageTest-1907861300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d140b166-d130-4c96-9afb-d072f806bb8f tempest-CreateVolumesFromImageTest-1907861300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d140b166-d130-4c96-9afb-d072f806bb8f tempest-CreateVolumesFromImageTest-1907861300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d140b166-d130-4c96-9afb-d072f806bb8f tempest-CreateVolumesFromImageTest-1907861300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:29 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:29 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:29 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d140b166-d130-4c96-9afb-d072f806bb8f tempest-CreateVolumesFromImageTest-1907861300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.578s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:29 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-d140b166-d130-4c96-9afb-d072f806bb8f tempest-CreateVolumesFromImageTest-1907861300 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:29 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d140b166-d130-4c96-9afb-d072f806bb8f tempest-CreateVolumesFromImageTest-1907861300 None] Deleted volume successfully. Feb 27 02:10:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-d140b166-d130-4c96-9afb-d072f806bb8f tempest-CreateVolumesFromImageTest-1907861300 None] Lock "cinder-17178a57-21c2-45c1-ac17-03a09ba6977b-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9cbe091e-312b-4468-a64c-f15799e4aacb tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9cbe091e-312b-4468-a64c-f15799e4aacb tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-9cbe091e-312b-4468-a64c-f15799e4aacb tempest-CreateVolumesFromSnapshotTest-596258211 None] Creating offline snapshot 2959dcc1-7a16-4542-845b-e89d08df95a1 of volume ca91730b-96e4-4409-870c-cd289bb70cc7 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:10:30 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9444ff76-7efe-4fda-8756-7b5e72d376e1]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9cbe091e-312b-4468-a64c-f15799e4aacb tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:30 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7 Feb 27 02:10:30 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:30 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9cbe091e-312b-4468-a64c-f15799e4aacb tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7" returned: 0 in 0.628s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9cbe091e-312b-4468-a64c-f15799e4aacb tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.2959dcc1-7a16-4542-845b-e89d08df95a1 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:30 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:30 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.2959dcc1-7a16-4542-845b-e89d08df95a1 1G Feb 27 02:10:30 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:30 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:30 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:31 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.491s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:31 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:31 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9cbe091e-312b-4468-a64c-f15799e4aacb tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.2959dcc1-7a16-4542-845b-e89d08df95a1 1G" returned: 0 in 0.834s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9cbe091e-312b-4468-a64c-f15799e4aacb tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca91730b-96e4-4409-870c-cd289bb70cc7 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.2959dcc1-7a16-4542-845b-e89d08df95a1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:31 devstack sudo[90127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca91730b-96e4-4409-870c-cd289bb70cc7 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.2959dcc1-7a16-4542-845b-e89d08df95a1 Feb 27 02:10:31 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:32 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9cbe091e-312b-4468-a64c-f15799e4aacb tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca91730b-96e4-4409-870c-cd289bb70cc7 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.2959dcc1-7a16-4542-845b-e89d08df95a1" returned: 0 in 0.553s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:32 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-9cbe091e-312b-4468-a64c-f15799e4aacb tempest-CreateVolumesFromSnapshotTest-596258211 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.2959dcc1-7a16-4542-845b-e89d08df95a1 is being set with open permissions: ugo+rw Feb 27 02:10:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9cbe091e-312b-4468-a64c-f15799e4aacb tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.2959dcc1-7a16-4542-845b-e89d08df95a1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:32 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.2959dcc1-7a16-4542-845b-e89d08df95a1 Feb 27 02:10:32 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:32 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Flow 'volume_create_manager' (1511cb7a-6992-433a-9981-c54578631494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e305a8-8b1c-4f92-bddd-5feadf2359ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e305a8-8b1c-4f92-bddd-5feadf2359ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035f184a-2e66-469c-b6b4-799ea1d9f377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d146cae4fa3b429c97d10a98691d5ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:33Z,use_quota=True,user_id='0caefbd8d295411f8076d8c854b195fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6f7c3e-f23f-4c19-a597-45cae9030695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6f7c3e-f23f-4c19-a597-45cae9030695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54f7a3a-d608-4121-9fc3-9c3cd975d6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54f7a3a-d608-4121-9fc3-9c3cd975d6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '035f184a-2e66-469c-b6b4-799ea1d9f377', 'volume_name': 'volume-035f184a-2e66-469c-b6b4-799ea1d9f377', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764752d8-6f9d-4d0d-a3ec-f911dcc7c935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764752d8-6f9d-4d0d-a3ec-f911dcc7c935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f526fc5-4918-4b8c-bacf-3dfa2ad5b627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:32 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Volume 035f184a-2e66-469c-b6b4-799ea1d9f377: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-035f184a-2e66-469c-b6b4-799ea1d9f377', 'volume_size': 1} Feb 27 02:10:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:32 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9cbe091e-312b-4468-a64c-f15799e4aacb tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.2959dcc1-7a16-4542-845b-e89d08df95a1" returned: 0 in 0.563s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9cbe091e-312b-4468-a64c-f15799e4aacb tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:32 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.info Feb 27 02:10:32 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:33 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9cbe091e-312b-4468-a64c-f15799e4aacb tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.info" returned: 0 in 0.455s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:33 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-9cbe091e-312b-4468-a64c-f15799e4aacb tempest-CreateVolumesFromSnapshotTest-596258211 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.info is being set with open permissions: ugo+rw Feb 27 02:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9cbe091e-312b-4468-a64c-f15799e4aacb tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:33 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.info Feb 27 02:10:33 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:33 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9cbe091e-312b-4468-a64c-f15799e4aacb tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.info" returned: 0 in 0.428s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9cbe091e-312b-4468-a64c-f15799e4aacb tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.545s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.025s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035f184a-2e66-469c-b6b4-799ea1d9f377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d146cae4fa3b429c97d10a98691d5ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:33Z,use_quota=True,user_id='0caefbd8d295411f8076d8c854b195fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Creating volume 035f184a-2e66-469c-b6b4-799ea1d9f377 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:33 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:10:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-035f184a-2e66-469c-b6b4-799ea1d9f377 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:33 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-035f184a-2e66-469c-b6b4-799ea1d9f377 1073741824 Feb 27 02:10:33 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:33 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-9cbe091e-312b-4468-a64c-f15799e4aacb tempest-CreateVolumesFromSnapshotTest-596258211 None] Create snapshot completed successfully Feb 27 02:10:34 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-035f184a-2e66-469c-b6b4-799ea1d9f377 1073741824" returned: 0 in 0.581s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-035f184a-2e66-469c-b6b4-799ea1d9f377 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:34 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-035f184a-2e66-469c-b6b4-799ea1d9f377 Feb 27 02:10:34 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:34 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-035f184a-2e66-469c-b6b4-799ea1d9f377" returned: 0 in 0.480s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f526fc5-4918-4b8c-bacf-3dfa2ad5b627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-035f184a-2e66-469c-b6b4-799ea1d9f377', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b0bd11-3de4-4f6e-a587-fb4c8df90743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:35 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Volume volume-035f184a-2e66-469c-b6b4-799ea1d9f377 (035f184a-2e66-469c-b6b4-799ea1d9f377): created successfully Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b0bd11-3de4-4f6e-a587-fb4c8df90743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Flow 'volume_create_manager' (1511cb7a-6992-433a-9981-c54578631494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:35 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a857963f-898e-4431-a260-346ba1bbe719 tempest-CinderUnicodeTest-1666121266 None] Created volume successfully. Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Flow 'volume_create_manager' (4a4c38f4-35b3-456c-814e-0a3297a9dfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c97ae2-30f1-4964-aac3-68641631eb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c97ae2-30f1-4964-aac3-68641631eb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2132634309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9c0f1d-85f5-4365-b8f4-ea34090dd158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9c48caada741d2b6b26efb98167317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:35Z,use_quota=True,user_id='e53fe6825a3745c586e330f9a3e70035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a0d3b4d-f2b2-45d7-a5eb-8e7caf22f387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a0d3b4d-f2b2-45d7-a5eb-8e7caf22f387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b232b8c-e927-47ae-b484-d155a2c1aea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b232b8c-e927-47ae-b484-d155a2c1aea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e9c0f1d-85f5-4365-b8f4-ea34090dd158', 'volume_name': 'volume-0e9c0f1d-85f5-4365-b8f4-ea34090dd158', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aaeecef-7aca-44df-b670-6fc1d28b5edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aaeecef-7aca-44df-b670-6fc1d28b5edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc470c33-7f47-41d6-9608-9c177b973684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:35 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Volume 0e9c0f1d-85f5-4365-b8f4-ea34090dd158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e9c0f1d-85f5-4365-b8f4-ea34090dd158', 'volume_size': 1} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2132634309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e9c0f1d-85f5-4365-b8f4-ea34090dd158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9c48caada741d2b6b26efb98167317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:35Z,use_quota=True,user_id='e53fe6825a3745c586e330f9a3e70035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Creating volume 0e9c0f1d-85f5-4365-b8f4-ea34090dd158 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:35 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:10:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e9c0f1d-85f5-4365-b8f4-ea34090dd158 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:35 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e9c0f1d-85f5-4365-b8f4-ea34090dd158 1073741824 Feb 27 02:10:35 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:36 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e9c0f1d-85f5-4365-b8f4-ea34090dd158 1073741824" returned: 0 in 0.537s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e9c0f1d-85f5-4365-b8f4-ea34090dd158 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:37 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e9c0f1d-85f5-4365-b8f4-ea34090dd158 Feb 27 02:10:37 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:37 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e9c0f1d-85f5-4365-b8f4-ea34090dd158" returned: 0 in 0.407s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] <== create_volume: return (2497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.499s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Flow 'volume_create_manager' (01c82462-b1a7-4d54-9623-6d0bc8a0b814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f3a864-a858-4afc-bf5c-44ec2ba0f350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f3a864-a858-4afc-bf5c-44ec2ba0f350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-19399537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14da951-6781-4b6a-8dfe-e1d61cc62494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9c48caada741d2b6b26efb98167317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:36Z,use_quota=True,user_id='e53fe6825a3745c586e330f9a3e70035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe7a7ec-d38f-4b32-8591-db4457cf62ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe7a7ec-d38f-4b32-8591-db4457cf62ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc5296d-1c43-4780-894d-35826beb2935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc5296d-1c43-4780-894d-35826beb2935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e14da951-6781-4b6a-8dfe-e1d61cc62494', 'volume_name': 'volume-e14da951-6781-4b6a-8dfe-e1d61cc62494', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ef45c8-d6f1-4cc8-8560-d5645ad02393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ef45c8-d6f1-4cc8-8560-d5645ad02393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8e1b77-8db7-4161-8aa3-70ab5d8ac2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:38 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Volume e14da951-6781-4b6a-8dfe-e1d61cc62494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e14da951-6781-4b6a-8dfe-e1d61cc62494', 'volume_size': 1} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-19399537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14da951-6781-4b6a-8dfe-e1d61cc62494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9c48caada741d2b6b26efb98167317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:36Z,use_quota=True,user_id='e53fe6825a3745c586e330f9a3e70035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Creating volume e14da951-6781-4b6a-8dfe-e1d61cc62494 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:38 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:10:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e14da951-6781-4b6a-8dfe-e1d61cc62494 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:38 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e14da951-6781-4b6a-8dfe-e1d61cc62494 1073741824 Feb 27 02:10:38 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:39 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e14da951-6781-4b6a-8dfe-e1d61cc62494 1073741824" returned: 0 in 0.479s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc470c33-7f47-41d6-9608-9c177b973684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e9c0f1d-85f5-4365-b8f4-ea34090dd158', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60817ecf-cad2-47d7-b0d6-ac99c419f877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Volume volume-0e9c0f1d-85f5-4365-b8f4-ea34090dd158 (0e9c0f1d-85f5-4365-b8f4-ea34090dd158): created successfully Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60817ecf-cad2-47d7-b0d6-ac99c419f877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Flow 'volume_create_manager' (4a4c38f4-35b3-456c-814e-0a3297a9dfa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e14da951-6781-4b6a-8dfe-e1d61cc62494 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:40 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c1051fef-b893-42ee-bc31-808507f26314 tempest-CreateVolumesFromSnapshotTest-596258211 None] Created volume successfully. Feb 27 02:10:40 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e14da951-6781-4b6a-8dfe-e1d61cc62494 Feb 27 02:10:40 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Flow 'volume_create_manager' (f81d168b-b097-4abd-b70d-95e051d5e1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c310a491-2a0b-42db-8101-b335447e29b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Flow 'volume_create_manager' (d2646742-e746-404a-9eb5-734a0a6c8ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed67142-77f8-445d-b4a1-084f02ce305f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c310a491-2a0b-42db-8101-b335447e29b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1859139401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=105beeca-0b86-41fd-b085-963b7baca65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d146cae4fa3b429c97d10a98691d5ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:40Z,use_quota=True,user_id='0caefbd8d295411f8076d8c854b195fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35a0293-f4ef-47e4-b264-a19b527f725b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35a0293-f4ef-47e4-b264-a19b527f725b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (befa1f77-d157-4a7c-9481-a3c05300b13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (befa1f77-d157-4a7c-9481-a3c05300b13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '105beeca-0b86-41fd-b085-963b7baca65c', 'volume_name': 'volume-105beeca-0b86-41fd-b085-963b7baca65c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df778fb-2cb3-4fdd-a9c8-627b693e3079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df778fb-2cb3-4fdd-a9c8-627b693e3079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0d2cd7-f77e-41ad-b835-4877c44ed304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Volume 105beeca-0b86-41fd-b085-963b7baca65c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-105beeca-0b86-41fd-b085-963b7baca65c', 'volume_size': 1} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed67142-77f8-445d-b4a1-084f02ce305f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2076025195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5707fe12-07de-446f-b4ce-ce3601851375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9c48caada741d2b6b26efb98167317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:40Z,use_quota=True,user_id='e53fe6825a3745c586e330f9a3e70035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d47c521-07a9-4b42-a2af-74ed3f98d6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d47c521-07a9-4b42-a2af-74ed3f98d6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99757a4-8cb7-4f4d-8571-46b5c85661c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99757a4-8cb7-4f4d-8571-46b5c85661c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5707fe12-07de-446f-b4ce-ce3601851375', 'volume_name': 'volume-5707fe12-07de-446f-b4ce-ce3601851375', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d17029-008f-472c-a63a-30d9da033845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d17029-008f-472c-a63a-30d9da033845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb0d672-73df-4960-bc49-534f0b70b664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Volume 5707fe12-07de-446f-b4ce-ce3601851375: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5707fe12-07de-446f-b4ce-ce3601851375', 'volume_size': 1} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Flow 'volume_create_manager' (fd4e3899-7416-4731-a4b7-5ddc4f38cbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17dc547-c87d-4cde-a019-405a47c8635f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17dc547-c87d-4cde-a019-405a47c8635f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1060366880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295e4b56-ddfd-4bce-a43d-24459cbc1a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9c48caada741d2b6b26efb98167317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:41Z,use_quota=True,user_id='e53fe6825a3745c586e330f9a3e70035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0133d74-4c8c-4a1e-b6a7-0f270b6358f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0133d74-4c8c-4a1e-b6a7-0f270b6358f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f4c665-26af-4272-9440-f845fa34a155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f4c665-26af-4272-9440-f845fa34a155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '295e4b56-ddfd-4bce-a43d-24459cbc1a75', 'volume_name': 'volume-295e4b56-ddfd-4bce-a43d-24459cbc1a75', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e690125e-c621-4557-9a6b-028e064d047e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e690125e-c621-4557-9a6b-028e064d047e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee55649-35e1-4571-bf79-0c79789b792a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Volume 295e4b56-ddfd-4bce-a43d-24459cbc1a75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-295e4b56-ddfd-4bce-a43d-24459cbc1a75', 'volume_size': 1} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:40 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Flow 'volume_create_manager' (e97acd61-1526-485f-894f-485110754c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd502b6-e0e9-4e19-bfe4-235613119569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e14da951-6781-4b6a-8dfe-e1d61cc62494" returned: 0 in 0.676s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.050s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1859139401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=105beeca-0b86-41fd-b085-963b7baca65c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d146cae4fa3b429c97d10a98691d5ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:40Z,use_quota=True,user_id='0caefbd8d295411f8076d8c854b195fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Creating volume 105beeca-0b86-41fd-b085-963b7baca65c {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:40 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd502b6-e0e9-4e19-bfe4-235613119569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1138337874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0387d00b-a337-4471-b2d2-20dc844328fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9c48caada741d2b6b26efb98167317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:41Z,use_quota=True,user_id='e53fe6825a3745c586e330f9a3e70035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb2bb6f-332f-4f2f-b5f6-6528ec778e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c 1073741824 Feb 27 02:10:40 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb2bb6f-332f-4f2f-b5f6-6528ec778e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed669d17-2fba-4ae0-8159-5dfcb6f38e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed669d17-2fba-4ae0-8159-5dfcb6f38e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0387d00b-a337-4471-b2d2-20dc844328fd', 'volume_name': 'volume-0387d00b-a337-4471-b2d2-20dc844328fd', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6edd8ec1-e1f3-4c3a-b180-dca78fbd7446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6edd8ec1-e1f3-4c3a-b180-dca78fbd7446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010b1288-2025-4a79-98de-10794eec645c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Volume 0387d00b-a337-4471-b2d2-20dc844328fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0387d00b-a337-4471-b2d2-20dc844328fd', 'volume_size': 1} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8e1b77-8db7-4161-8aa3-70ab5d8ac2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e14da951-6781-4b6a-8dfe-e1d61cc62494', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7215b83f-d6f7-4cc5-b333-1f87d39f6dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:40 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Volume volume-e14da951-6781-4b6a-8dfe-e1d61cc62494 (e14da951-6781-4b6a-8dfe-e1d61cc62494): created successfully Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7215b83f-d6f7-4cc5-b333-1f87d39f6dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Flow 'volume_create_manager' (01c82462-b1a7-4d54-9623-6d0bc8a0b814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:40 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-4cfadd55-d688-4412-8096-d78833871308 tempest-CreateVolumesFromSnapshotTest-596258211 None] Created volume successfully. Feb 27 02:10:41 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c 1073741824" returned: 0 in 0.611s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:41 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c Feb 27 02:10:41 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:42 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c" returned: 0 in 0.504s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.423s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2076025195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5707fe12-07de-446f-b4ce-ce3601851375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9c48caada741d2b6b26efb98167317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:40Z,use_quota=True,user_id='e53fe6825a3745c586e330f9a3e70035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Creating volume 5707fe12-07de-446f-b4ce-ce3601851375 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:42 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5707fe12-07de-446f-b4ce-ce3601851375 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0d2cd7-f77e-41ad-b835-4877c44ed304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-105beeca-0b86-41fd-b085-963b7baca65c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f95936-bac3-4330-abc2-56200b95ffca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:42 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5707fe12-07de-446f-b4ce-ce3601851375 1073741824 Feb 27 02:10:42 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:42 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Volume volume-105beeca-0b86-41fd-b085-963b7baca65c (105beeca-0b86-41fd-b085-963b7baca65c): created successfully Feb 27 02:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f95936-bac3-4330-abc2-56200b95ffca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:42 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Flow 'volume_create_manager' (f81d168b-b097-4abd-b70d-95e051d5e1dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:42 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-9cd4779b-37af-411b-8f72-0739cad8f7a1 tempest-CinderUnicodeTest-1666121266 None] Created volume successfully. Feb 27 02:10:42 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5707fe12-07de-446f-b4ce-ce3601851375 1073741824" returned: 0 in 0.616s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5707fe12-07de-446f-b4ce-ce3601851375 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:42 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5707fe12-07de-446f-b4ce-ce3601851375 Feb 27 02:10:42 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-71996d37-65f9-4a8a-8a95-0420a1e4962f tempest-CinderUnicodeTest-1666121266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:43 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5707fe12-07de-446f-b4ce-ce3601851375" returned: 0 in 0.527s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.512s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1060366880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295e4b56-ddfd-4bce-a43d-24459cbc1a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9c48caada741d2b6b26efb98167317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:41Z,use_quota=True,user_id='e53fe6825a3745c586e330f9a3e70035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Creating volume 295e4b56-ddfd-4bce-a43d-24459cbc1a75 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:43 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:10:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-295e4b56-ddfd-4bce-a43d-24459cbc1a75 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb0d672-73df-4960-bc49-534f0b70b664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5707fe12-07de-446f-b4ce-ce3601851375', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc38736-43ac-430c-93fc-5c4f3f218d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:43 devstack sudo[90223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-295e4b56-ddfd-4bce-a43d-24459cbc1a75 1073741824 Feb 27 02:10:43 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:43 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Volume volume-5707fe12-07de-446f-b4ce-ce3601851375 (5707fe12-07de-446f-b4ce-ce3601851375): created successfully Feb 27 02:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc38736-43ac-430c-93fc-5c4f3f218d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:43 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Flow 'volume_create_manager' (d2646742-e746-404a-9eb5-734a0a6c8ec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:43 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2d2c11e7-0f9e-4c00-8645-9cf3d9a05519 tempest-CreateVolumesFromSnapshotTest-596258211 None] Created volume successfully. Feb 27 02:10:43 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-295e4b56-ddfd-4bce-a43d-24459cbc1a75 1073741824" returned: 0 in 0.580s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-295e4b56-ddfd-4bce-a43d-24459cbc1a75 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:43 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-295e4b56-ddfd-4bce-a43d-24459cbc1a75 Feb 27 02:10:43 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:44 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-295e4b56-ddfd-4bce-a43d-24459cbc1a75" returned: 0 in 0.513s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.404s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1138337874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0387d00b-a337-4471-b2d2-20dc844328fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9c48caada741d2b6b26efb98167317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:41Z,use_quota=True,user_id='e53fe6825a3745c586e330f9a3e70035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Creating volume 0387d00b-a337-4471-b2d2-20dc844328fd {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:44 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:10:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0387d00b-a337-4471-b2d2-20dc844328fd 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee55649-35e1-4571-bf79-0c79789b792a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-295e4b56-ddfd-4bce-a43d-24459cbc1a75', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bf1d3a-cb72-459d-a000-467160e58e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:44 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0387d00b-a337-4471-b2d2-20dc844328fd 1073741824 Feb 27 02:10:44 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:44 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Volume volume-295e4b56-ddfd-4bce-a43d-24459cbc1a75 (295e4b56-ddfd-4bce-a43d-24459cbc1a75): created successfully Feb 27 02:10:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bf1d3a-cb72-459d-a000-467160e58e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:44 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Flow 'volume_create_manager' (fd4e3899-7416-4731-a4b7-5ddc4f38cbaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:44 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-753fec91-58d2-4dcc-8d1d-21d070a93847 tempest-CreateVolumesFromSnapshotTest-596258211 None] Created volume successfully. Feb 27 02:10:44 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0387d00b-a337-4471-b2d2-20dc844328fd 1073741824" returned: 0 in 0.571s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0387d00b-a337-4471-b2d2-20dc844328fd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:44 devstack sudo[90236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0387d00b-a337-4471-b2d2-20dc844328fd Feb 27 02:10:44 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:45 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0387d00b-a337-4471-b2d2-20dc844328fd" returned: 0 in 0.417s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-71996d37-65f9-4a8a-8a95-0420a1e4962f tempest-CinderUnicodeTest-1666121266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.629s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010b1288-2025-4a79-98de-10794eec645c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0387d00b-a337-4471-b2d2-20dc844328fd', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124a8bc9-5105-4c17-8a5f-2dd4da40f2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:45 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Volume volume-0387d00b-a337-4471-b2d2-20dc844328fd (0387d00b-a337-4471-b2d2-20dc844328fd): created successfully Feb 27 02:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124a8bc9-5105-4c17-8a5f-2dd4da40f2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Flow 'volume_create_manager' (e97acd61-1526-485f-894f-485110754c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-71996d37-65f9-4a8a-8a95-0420a1e4962f tempest-CinderUnicodeTest-1666121266 None] Creating offline snapshot 66d6db96-53f7-4dec-9e65-8f3b04c2f118 of volume 105beeca-0b86-41fd-b085-963b7baca65c {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:10:45 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e5b451f2-2cb2-4950-a2ca-bc0835111431 tempest-CreateVolumesFromSnapshotTest-596258211 None] Created volume successfully. Feb 27 02:10:45 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[70702d79-dd4c-4e0f-83a0-d0dee4c12814]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-71996d37-65f9-4a8a-8a95-0420a1e4962f tempest-CinderUnicodeTest-1666121266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:45 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c Feb 27 02:10:45 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:45 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-71996d37-65f9-4a8a-8a95-0420a1e4962f tempest-CinderUnicodeTest-1666121266 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c" returned: 0 in 0.482s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-71996d37-65f9-4a8a-8a95-0420a1e4962f tempest-CinderUnicodeTest-1666121266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.66d6db96-53f7-4dec-9e65-8f3b04c2f118 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:45 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.66d6db96-53f7-4dec-9e65-8f3b04c2f118 1G Feb 27 02:10:45 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7100e751-9e83-441e-82d7-b7cbc2807570 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "cinder-0387d00b-a337-4471-b2d2-20dc844328fd-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7100e751-9e83-441e-82d7-b7cbc2807570 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-0387d00b-a337-4471-b2d2-20dc844328fd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7100e751-9e83-441e-82d7-b7cbc2807570 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "cinder-quobyte-0387d00b-a337-4471-b2d2-20dc844328fd" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7100e751-9e83-441e-82d7-b7cbc2807570 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-quobyte-0387d00b-a337-4471-b2d2-20dc844328fd" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:46 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[69504875-7069-41ce-a234-65da4ef58b2b]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7100e751-9e83-441e-82d7-b7cbc2807570 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0387d00b-a337-4471-b2d2-20dc844328fd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:46 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-71996d37-65f9-4a8a-8a95-0420a1e4962f tempest-CinderUnicodeTest-1666121266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.66d6db96-53f7-4dec-9e65-8f3b04c2f118 1G" returned: 0 in 0.560s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-71996d37-65f9-4a8a-8a95-0420a1e4962f tempest-CinderUnicodeTest-1666121266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-105beeca-0b86-41fd-b085-963b7baca65c -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.66d6db96-53f7-4dec-9e65-8f3b04c2f118 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:46 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-105beeca-0b86-41fd-b085-963b7baca65c -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.66d6db96-53f7-4dec-9e65-8f3b04c2f118 Feb 27 02:10:46 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:46 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0387d00b-a337-4471-b2d2-20dc844328fd Feb 27 02:10:46 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:46 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7100e751-9e83-441e-82d7-b7cbc2807570 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0387d00b-a337-4471-b2d2-20dc844328fd" returned: 0 in 0.518s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7100e751-9e83-441e-82d7-b7cbc2807570 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0387d00b-a337-4471-b2d2-20dc844328fd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:46 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0387d00b-a337-4471-b2d2-20dc844328fd Feb 27 02:10:46 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:46 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-71996d37-65f9-4a8a-8a95-0420a1e4962f tempest-CinderUnicodeTest-1666121266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-105beeca-0b86-41fd-b085-963b7baca65c -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.66d6db96-53f7-4dec-9e65-8f3b04c2f118" returned: 0 in 0.503s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:46 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-71996d37-65f9-4a8a-8a95-0420a1e4962f tempest-CinderUnicodeTest-1666121266 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.66d6db96-53f7-4dec-9e65-8f3b04c2f118 is being set with open permissions: ugo+rw Feb 27 02:10:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-71996d37-65f9-4a8a-8a95-0420a1e4962f tempest-CinderUnicodeTest-1666121266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.66d6db96-53f7-4dec-9e65-8f3b04c2f118 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:47 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.66d6db96-53f7-4dec-9e65-8f3b04c2f118 Feb 27 02:10:47 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:47 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7100e751-9e83-441e-82d7-b7cbc2807570 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0387d00b-a337-4471-b2d2-20dc844328fd" returned: 0 in 0.403s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7100e751-9e83-441e-82d7-b7cbc2807570 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-quobyte-0387d00b-a337-4471-b2d2-20dc844328fd" released by "delete_volume" :: held 0.956s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:47 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-7100e751-9e83-441e-82d7-b7cbc2807570 tempest-CreateVolumesFromSnapshotTest-596258211 None] Created reservations ['821db7a5-4105-40b0-abfc-ef12f5ad30d7', 'beda3a5b-602a-43f8-949d-8aca54fe082d', '8373f7ac-b630-4e16-adfe-b5e36fa918c7', '6b454845-1c56-4454-89e5-7476a08afad6'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:47 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-71996d37-65f9-4a8a-8a95-0420a1e4962f tempest-CinderUnicodeTest-1666121266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.66d6db96-53f7-4dec-9e65-8f3b04c2f118" returned: 0 in 0.463s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7100e751-9e83-441e-82d7-b7cbc2807570 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7100e751-9e83-441e-82d7-b7cbc2807570 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7100e751-9e83-441e-82d7-b7cbc2807570 tempest-CreateVolumesFromSnapshotTest-596258211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7100e751-9e83-441e-82d7-b7cbc2807570 tempest-CreateVolumesFromSnapshotTest-596258211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7100e751-9e83-441e-82d7-b7cbc2807570 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7100e751-9e83-441e-82d7-b7cbc2807570 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:47 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:47 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-71996d37-65f9-4a8a-8a95-0420a1e4962f tempest-CinderUnicodeTest-1666121266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:47 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.info Feb 27 02:10:47 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:47 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7100e751-9e83-441e-82d7-b7cbc2807570 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.402s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:47 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-7100e751-9e83-441e-82d7-b7cbc2807570 tempest-CreateVolumesFromSnapshotTest-596258211 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:47 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7100e751-9e83-441e-82d7-b7cbc2807570 tempest-CreateVolumesFromSnapshotTest-596258211 None] Deleted volume successfully. Feb 27 02:10:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7100e751-9e83-441e-82d7-b7cbc2807570 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-0387d00b-a337-4471-b2d2-20dc844328fd-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:47 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-71996d37-65f9-4a8a-8a95-0420a1e4962f tempest-CinderUnicodeTest-1666121266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.info" returned: 0 in 0.460s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:47 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-71996d37-65f9-4a8a-8a95-0420a1e4962f tempest-CinderUnicodeTest-1666121266 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.info is being set with open permissions: ugo+rw Feb 27 02:10:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-71996d37-65f9-4a8a-8a95-0420a1e4962f tempest-CinderUnicodeTest-1666121266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:47 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.info Feb 27 02:10:48 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:48 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-71996d37-65f9-4a8a-8a95-0420a1e4962f tempest-CinderUnicodeTest-1666121266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.info" returned: 0 in 0.409s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-71996d37-65f9-4a8a-8a95-0420a1e4962f tempest-CinderUnicodeTest-1666121266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:48 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-71996d37-65f9-4a8a-8a95-0420a1e4962f tempest-CinderUnicodeTest-1666121266 None] Create snapshot completed successfully Feb 27 02:10:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ce32c63e-f7ed-4c60-9404-6303c77e2b77 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "cinder-295e4b56-ddfd-4bce-a43d-24459cbc1a75-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ce32c63e-f7ed-4c60-9404-6303c77e2b77 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-295e4b56-ddfd-4bce-a43d-24459cbc1a75-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ce32c63e-f7ed-4c60-9404-6303c77e2b77 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "cinder-quobyte-295e4b56-ddfd-4bce-a43d-24459cbc1a75" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ce32c63e-f7ed-4c60-9404-6303c77e2b77 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-quobyte-295e4b56-ddfd-4bce-a43d-24459cbc1a75" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:48 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f16a58-be46-44c4-b273-6158dfd70987]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ce32c63e-f7ed-4c60-9404-6303c77e2b77 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-295e4b56-ddfd-4bce-a43d-24459cbc1a75 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:48 devstack sudo[90275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-295e4b56-ddfd-4bce-a43d-24459cbc1a75 Feb 27 02:10:48 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] Acquiring lock "cinder-66d6db96-53f7-4dec-9e65-8f3b04c2f118-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] Lock "cinder-66d6db96-53f7-4dec-9e65-8f3b04c2f118-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] Acquiring lock "cinder-quobyte-105beeca-0b86-41fd-b085-963b7baca65c" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] Lock "cinder-quobyte-105beeca-0b86-41fd-b085-963b7baca65c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] Acquiring lock "cinder-quobyte-66d6db96-53f7-4dec-9e65-8f3b04c2f118" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] Lock "cinder-quobyte-66d6db96-53f7-4dec-9e65-8f3b04c2f118" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] Deleting offline snapshot 66d6db96-53f7-4dec-9e65-8f3b04c2f118 of volume 105beeca-0b86-41fd-b085-963b7baca65c {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] snapshot_file for this snap is: volume-105beeca-0b86-41fd-b085-963b7baca65c.66d6db96-53f7-4dec-9e65-8f3b04c2f118 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20dd37d-ac65-4d72-80cd-487e4ccf46bf]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.66d6db96-53f7-4dec-9e65-8f3b04c2f118 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:49 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ce32c63e-f7ed-4c60-9404-6303c77e2b77 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-295e4b56-ddfd-4bce-a43d-24459cbc1a75" returned: 0 in 0.532s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ce32c63e-f7ed-4c60-9404-6303c77e2b77 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-295e4b56-ddfd-4bce-a43d-24459cbc1a75 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:49 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.66d6db96-53f7-4dec-9e65-8f3b04c2f118 Feb 27 02:10:49 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:49 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-295e4b56-ddfd-4bce-a43d-24459cbc1a75 Feb 27 02:10:49 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:49 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.66d6db96-53f7-4dec-9e65-8f3b04c2f118" returned: 0 in 0.511s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-105beeca-0b86-41fd-b085-963b7baca65c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4f53da-13eb-4a08-86cb-bcaf7156fff8]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:49 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ce32c63e-f7ed-4c60-9404-6303c77e2b77 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-295e4b56-ddfd-4bce-a43d-24459cbc1a75" returned: 0 in 0.486s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ce32c63e-f7ed-4c60-9404-6303c77e2b77 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-quobyte-295e4b56-ddfd-4bce-a43d-24459cbc1a75" released by "delete_volume" :: held 1.046s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:49 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c Feb 27 02:10:49 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ce32c63e-f7ed-4c60-9404-6303c77e2b77 tempest-CreateVolumesFromSnapshotTest-596258211 None] Created reservations ['3ea51782-aa00-4b4e-b91d-db4b0d52d0bc', '19fe5e1b-482f-4762-badc-23ed1c4d3268', 'd1750175-816f-43cf-9f9a-f85fd6795f83', '7c08cdd6-95dd-474e-821d-1684fe49fac7'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ce32c63e-f7ed-4c60-9404-6303c77e2b77 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ce32c63e-f7ed-4c60-9404-6303c77e2b77 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ce32c63e-f7ed-4c60-9404-6303c77e2b77 tempest-CreateVolumesFromSnapshotTest-596258211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ce32c63e-f7ed-4c60-9404-6303c77e2b77 tempest-CreateVolumesFromSnapshotTest-596258211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ce32c63e-f7ed-4c60-9404-6303c77e2b77 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ce32c63e-f7ed-4c60-9404-6303c77e2b77 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:49 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:49 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:50 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c" returned: 0 in 0.531s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.66d6db96-53f7-4dec-9e65-8f3b04c2f118 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:50 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.66d6db96-53f7-4dec-9e65-8f3b04c2f118 Feb 27 02:10:50 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:50 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ce32c63e-f7ed-4c60-9404-6303c77e2b77 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.522s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:50 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-ce32c63e-f7ed-4c60-9404-6303c77e2b77 tempest-CreateVolumesFromSnapshotTest-596258211 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:50 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ce32c63e-f7ed-4c60-9404-6303c77e2b77 tempest-CreateVolumesFromSnapshotTest-596258211 None] Deleted volume successfully. Feb 27 02:10:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ce32c63e-f7ed-4c60-9404-6303c77e2b77 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-295e4b56-ddfd-4bce-a43d-24459cbc1a75-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:50 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.66d6db96-53f7-4dec-9e65-8f3b04c2f118" returned: 0 in 0.446s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.66d6db96-53f7-4dec-9e65-8f3b04c2f118 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:50 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.66d6db96-53f7-4dec-9e65-8f3b04c2f118 Feb 27 02:10:50 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-14aff158-dec6-49df-9cd8-d6c118418d2b tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "cinder-5707fe12-07de-446f-b4ce-ce3601851375-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-14aff158-dec6-49df-9cd8-d6c118418d2b tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-5707fe12-07de-446f-b4ce-ce3601851375-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-14aff158-dec6-49df-9cd8-d6c118418d2b tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "cinder-quobyte-5707fe12-07de-446f-b4ce-ce3601851375" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-14aff158-dec6-49df-9cd8-d6c118418d2b tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-quobyte-5707fe12-07de-446f-b4ce-ce3601851375" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:50 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[40309aa1-563d-4804-8fc5-f0d0fdf76bcd]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-14aff158-dec6-49df-9cd8-d6c118418d2b tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5707fe12-07de-446f-b4ce-ce3601851375 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:50 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5707fe12-07de-446f-b4ce-ce3601851375 Feb 27 02:10:50 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:51 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c.66d6db96-53f7-4dec-9e65-8f3b04c2f118" returned: 0 in 0.448s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] Lock "cinder-quobyte-66d6db96-53f7-4dec-9e65-8f3b04c2f118" released by "_delete_snapshot" :: held 1.998s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] Lock "cinder-quobyte-105beeca-0b86-41fd-b085-963b7baca65c" released by "delete_snapshot" :: held 2.017s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] Created reservations ['ef2a6899-c04c-4815-aa0f-a1adeb2721cd', '448d5394-becb-4f48-a172-d6583190144e', 'c6a7ab19-d446-4b74-965c-2ddc1731e119', 'ea8874c5-af02-4cfb-b503-18938841bc73'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:51 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] Delete snapshot completed successfully. Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-48508f14-aaf4-4935-a98f-ee9b7e6fc2d7 tempest-CinderUnicodeTest-1666121266 None] Lock "cinder-66d6db96-53f7-4dec-9e65-8f3b04c2f118-delete_snapshot" released by "delete_snapshot" :: held 2.148s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:51 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-14aff158-dec6-49df-9cd8-d6c118418d2b tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5707fe12-07de-446f-b4ce-ce3601851375" returned: 0 in 0.503s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-14aff158-dec6-49df-9cd8-d6c118418d2b tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5707fe12-07de-446f-b4ce-ce3601851375 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:51 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5707fe12-07de-446f-b4ce-ce3601851375 Feb 27 02:10:51 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:51 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-14aff158-dec6-49df-9cd8-d6c118418d2b tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5707fe12-07de-446f-b4ce-ce3601851375" returned: 0 in 0.436s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-14aff158-dec6-49df-9cd8-d6c118418d2b tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-quobyte-5707fe12-07de-446f-b4ce-ce3601851375" released by "delete_volume" :: held 0.974s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-14aff158-dec6-49df-9cd8-d6c118418d2b tempest-CreateVolumesFromSnapshotTest-596258211 None] Created reservations ['7684a2e8-76e3-4f89-abf9-4a57325a9dc7', '67b63e9b-6fab-4937-98f8-bde191a60cf9', '48bf9205-fcb5-4c33-9aa4-dc595744d772', 'a49cde36-bc3c-4f64-a86c-bb57c0df4c32'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-14aff158-dec6-49df-9cd8-d6c118418d2b tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-14aff158-dec6-49df-9cd8-d6c118418d2b tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-14aff158-dec6-49df-9cd8-d6c118418d2b tempest-CreateVolumesFromSnapshotTest-596258211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-14aff158-dec6-49df-9cd8-d6c118418d2b tempest-CreateVolumesFromSnapshotTest-596258211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-14aff158-dec6-49df-9cd8-d6c118418d2b tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-14aff158-dec6-49df-9cd8-d6c118418d2b tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:51 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:51 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-534d7170-2270-4679-a1db-808072c989de tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "cinder-e14da951-6781-4b6a-8dfe-e1d61cc62494-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-534d7170-2270-4679-a1db-808072c989de tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-e14da951-6781-4b6a-8dfe-e1d61cc62494-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-534d7170-2270-4679-a1db-808072c989de tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "cinder-quobyte-e14da951-6781-4b6a-8dfe-e1d61cc62494" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-534d7170-2270-4679-a1db-808072c989de tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-quobyte-e14da951-6781-4b6a-8dfe-e1d61cc62494" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2973ad6f-db58-4ba3-9cd0-cfba65f87a68]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-534d7170-2270-4679-a1db-808072c989de tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e14da951-6781-4b6a-8dfe-e1d61cc62494 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:52 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e14da951-6781-4b6a-8dfe-e1d61cc62494 Feb 27 02:10:52 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1b2369f3-cc94-410b-a259-74fc316e2aa8 tempest-CinderUnicodeTest-1666121266 None] Acquiring lock "cinder-105beeca-0b86-41fd-b085-963b7baca65c-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1b2369f3-cc94-410b-a259-74fc316e2aa8 tempest-CinderUnicodeTest-1666121266 None] Lock "cinder-105beeca-0b86-41fd-b085-963b7baca65c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1b2369f3-cc94-410b-a259-74fc316e2aa8 tempest-CinderUnicodeTest-1666121266 None] Acquiring lock "cinder-quobyte-105beeca-0b86-41fd-b085-963b7baca65c" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1b2369f3-cc94-410b-a259-74fc316e2aa8 tempest-CinderUnicodeTest-1666121266 None] Lock "cinder-quobyte-105beeca-0b86-41fd-b085-963b7baca65c" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:52 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb918ed-9493-49c8-b235-eb086cf0fc0a]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1b2369f3-cc94-410b-a259-74fc316e2aa8 tempest-CinderUnicodeTest-1666121266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:52 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-14aff158-dec6-49df-9cd8-d6c118418d2b tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.531s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:52 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-14aff158-dec6-49df-9cd8-d6c118418d2b tempest-CreateVolumesFromSnapshotTest-596258211 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:52 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-14aff158-dec6-49df-9cd8-d6c118418d2b tempest-CreateVolumesFromSnapshotTest-596258211 None] Deleted volume successfully. Feb 27 02:10:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-14aff158-dec6-49df-9cd8-d6c118418d2b tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-5707fe12-07de-446f-b4ce-ce3601851375-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:52 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c Feb 27 02:10:52 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:52 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-534d7170-2270-4679-a1db-808072c989de tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e14da951-6781-4b6a-8dfe-e1d61cc62494" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-534d7170-2270-4679-a1db-808072c989de tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e14da951-6781-4b6a-8dfe-e1d61cc62494 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:52 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e14da951-6781-4b6a-8dfe-e1d61cc62494 Feb 27 02:10:52 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:52 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1b2369f3-cc94-410b-a259-74fc316e2aa8 tempest-CinderUnicodeTest-1666121266 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c" returned: 0 in 0.589s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1b2369f3-cc94-410b-a259-74fc316e2aa8 tempest-CinderUnicodeTest-1666121266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:52 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-534d7170-2270-4679-a1db-808072c989de tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-e14da951-6781-4b6a-8dfe-e1d61cc62494" returned: 0 in 0.416s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:52 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c Feb 27 02:10:52 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-534d7170-2270-4679-a1db-808072c989de tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-quobyte-e14da951-6781-4b6a-8dfe-e1d61cc62494" released by "delete_volume" :: held 0.986s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:52 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-534d7170-2270-4679-a1db-808072c989de tempest-CreateVolumesFromSnapshotTest-596258211 None] Created reservations ['37f08a0b-07a8-4cb6-a5b8-8d542511b305', 'b295e4c9-bc63-4039-aff1-cf0ee49d9b44', '086df1ad-33c8-4ce6-aa82-d19dc4b13b80', '403f796d-8115-4a0d-9ae5-c74723e854b1'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-534d7170-2270-4679-a1db-808072c989de tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-534d7170-2270-4679-a1db-808072c989de tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-534d7170-2270-4679-a1db-808072c989de tempest-CreateVolumesFromSnapshotTest-596258211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-534d7170-2270-4679-a1db-808072c989de tempest-CreateVolumesFromSnapshotTest-596258211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-534d7170-2270-4679-a1db-808072c989de tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-534d7170-2270-4679-a1db-808072c989de tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:53 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:53 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:53 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:53 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1b2369f3-cc94-410b-a259-74fc316e2aa8 tempest-CinderUnicodeTest-1666121266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-105beeca-0b86-41fd-b085-963b7baca65c" returned: 0 in 0.570s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-534d7170-2270-4679-a1db-808072c989de tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.440s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:53 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-534d7170-2270-4679-a1db-808072c989de tempest-CreateVolumesFromSnapshotTest-596258211 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1b2369f3-cc94-410b-a259-74fc316e2aa8 tempest-CinderUnicodeTest-1666121266 None] Lock "cinder-quobyte-105beeca-0b86-41fd-b085-963b7baca65c" released by "delete_volume" :: held 1.197s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:53 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:UPDATE=241,cinder:SELECT=172,cinder:INSERT=58,cinder:DELETE=18 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:10:53 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-534d7170-2270-4679-a1db-808072c989de tempest-CreateVolumesFromSnapshotTest-596258211 None] Deleted volume successfully. Feb 27 02:10:53 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-1b2369f3-cc94-410b-a259-74fc316e2aa8 tempest-CinderUnicodeTest-1666121266 None] Created reservations ['ba8cd39d-96aa-4f74-8acc-0315278d236e', 'dca29698-21eb-4113-b5a7-4fed92956913', 'e762d217-fe6c-4a05-bc5c-3156d2b0b57d', '6ccb6493-3ec0-4417-9505-a6d0d412efa6'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:53 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-534d7170-2270-4679-a1db-808072c989de tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-e14da951-6781-4b6a-8dfe-e1d61cc62494-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1b2369f3-cc94-410b-a259-74fc316e2aa8 tempest-CinderUnicodeTest-1666121266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1b2369f3-cc94-410b-a259-74fc316e2aa8 tempest-CinderUnicodeTest-1666121266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1b2369f3-cc94-410b-a259-74fc316e2aa8 tempest-CinderUnicodeTest-1666121266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:53 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1b2369f3-cc94-410b-a259-74fc316e2aa8 tempest-CinderUnicodeTest-1666121266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1b2369f3-cc94-410b-a259-74fc316e2aa8 tempest-CinderUnicodeTest-1666121266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1b2369f3-cc94-410b-a259-74fc316e2aa8 tempest-CinderUnicodeTest-1666121266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:53 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:53 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:54 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1b2369f3-cc94-410b-a259-74fc316e2aa8 tempest-CinderUnicodeTest-1666121266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.396s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:54 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-1b2369f3-cc94-410b-a259-74fc316e2aa8 tempest-CinderUnicodeTest-1666121266 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:54 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1b2369f3-cc94-410b-a259-74fc316e2aa8 tempest-CinderUnicodeTest-1666121266 None] Deleted volume successfully. Feb 27 02:10:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1b2369f3-cc94-410b-a259-74fc316e2aa8 tempest-CinderUnicodeTest-1666121266 None] Lock "cinder-105beeca-0b86-41fd-b085-963b7baca65c-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b34e3002-33c4-417b-8cb0-292fce58c8e8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "cinder-0e9c0f1d-85f5-4365-b8f4-ea34090dd158-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b34e3002-33c4-417b-8cb0-292fce58c8e8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-0e9c0f1d-85f5-4365-b8f4-ea34090dd158-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b34e3002-33c4-417b-8cb0-292fce58c8e8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "cinder-quobyte-0e9c0f1d-85f5-4365-b8f4-ea34090dd158" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b34e3002-33c4-417b-8cb0-292fce58c8e8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-quobyte-0e9c0f1d-85f5-4365-b8f4-ea34090dd158" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:54 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd9ad34-0657-47a7-8896-85a60843f360]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b34e3002-33c4-417b-8cb0-292fce58c8e8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e9c0f1d-85f5-4365-b8f4-ea34090dd158 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:54 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e9c0f1d-85f5-4365-b8f4-ea34090dd158 Feb 27 02:10:54 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f8052eff-4a67-454f-ab71-cf22c31f5d09 tempest-CinderUnicodeTest-1666121266 None] Acquiring lock "cinder-035f184a-2e66-469c-b6b4-799ea1d9f377-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f8052eff-4a67-454f-ab71-cf22c31f5d09 tempest-CinderUnicodeTest-1666121266 None] Lock "cinder-035f184a-2e66-469c-b6b4-799ea1d9f377-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f8052eff-4a67-454f-ab71-cf22c31f5d09 tempest-CinderUnicodeTest-1666121266 None] Acquiring lock "cinder-quobyte-035f184a-2e66-469c-b6b4-799ea1d9f377" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f8052eff-4a67-454f-ab71-cf22c31f5d09 tempest-CinderUnicodeTest-1666121266 None] Lock "cinder-quobyte-035f184a-2e66-469c-b6b4-799ea1d9f377" acquired by "delete_volume" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:54 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[729049bd-aba5-4248-814f-d339c20e9d30]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f8052eff-4a67-454f-ab71-cf22c31f5d09 tempest-CinderUnicodeTest-1666121266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-035f184a-2e66-469c-b6b4-799ea1d9f377 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:54 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-035f184a-2e66-469c-b6b4-799ea1d9f377 Feb 27 02:10:54 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:54 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b34e3002-33c4-417b-8cb0-292fce58c8e8 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e9c0f1d-85f5-4365-b8f4-ea34090dd158" returned: 0 in 0.509s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b34e3002-33c4-417b-8cb0-292fce58c8e8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e9c0f1d-85f5-4365-b8f4-ea34090dd158 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:54 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e9c0f1d-85f5-4365-b8f4-ea34090dd158 Feb 27 02:10:54 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:54 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f8052eff-4a67-454f-ab71-cf22c31f5d09 tempest-CinderUnicodeTest-1666121266 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-035f184a-2e66-469c-b6b4-799ea1d9f377" returned: 0 in 0.485s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f8052eff-4a67-454f-ab71-cf22c31f5d09 tempest-CinderUnicodeTest-1666121266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-035f184a-2e66-469c-b6b4-799ea1d9f377 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:54 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-035f184a-2e66-469c-b6b4-799ea1d9f377 Feb 27 02:10:54 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:55 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b34e3002-33c4-417b-8cb0-292fce58c8e8 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e9c0f1d-85f5-4365-b8f4-ea34090dd158" returned: 0 in 0.474s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b34e3002-33c4-417b-8cb0-292fce58c8e8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-quobyte-0e9c0f1d-85f5-4365-b8f4-ea34090dd158" released by "delete_volume" :: held 1.015s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-b34e3002-33c4-417b-8cb0-292fce58c8e8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Created reservations ['34a4f765-1f90-4ca0-894c-abb3a7b8725b', '409a5049-8388-4def-a5ed-7de0eca62e96', '4e4c2481-acb7-439d-969b-9c80e503d7ba', '26537143-a1e6-4427-bea7-d49019d8e20b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b34e3002-33c4-417b-8cb0-292fce58c8e8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b34e3002-33c4-417b-8cb0-292fce58c8e8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b34e3002-33c4-417b-8cb0-292fce58c8e8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b34e3002-33c4-417b-8cb0-292fce58c8e8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b34e3002-33c4-417b-8cb0-292fce58c8e8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b34e3002-33c4-417b-8cb0-292fce58c8e8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:55 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:55 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:55 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f8052eff-4a67-454f-ab71-cf22c31f5d09 tempest-CinderUnicodeTest-1666121266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-035f184a-2e66-469c-b6b4-799ea1d9f377" returned: 0 in 0.496s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f8052eff-4a67-454f-ab71-cf22c31f5d09 tempest-CinderUnicodeTest-1666121266 None] Lock "cinder-quobyte-035f184a-2e66-469c-b6b4-799ea1d9f377" released by "delete_volume" :: held 1.006s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:UPDATE=231,cinder:DELETE=25,cinder:SELECT=175,cinder:INSERT=68 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-f8052eff-4a67-454f-ab71-cf22c31f5d09 tempest-CinderUnicodeTest-1666121266 None] Created reservations ['1f63ef4c-fd07-4dc1-af55-52006f796fb0', '38e15842-4de3-4036-b902-fae1bf06e1b7', '49b52940-3d2d-4d2e-a3d5-cd15cf1f2958', '7a21ee88-af3b-45a3-b17f-63d89e1e8303'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f8052eff-4a67-454f-ab71-cf22c31f5d09 tempest-CinderUnicodeTest-1666121266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f8052eff-4a67-454f-ab71-cf22c31f5d09 tempest-CinderUnicodeTest-1666121266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f8052eff-4a67-454f-ab71-cf22c31f5d09 tempest-CinderUnicodeTest-1666121266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f8052eff-4a67-454f-ab71-cf22c31f5d09 tempest-CinderUnicodeTest-1666121266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f8052eff-4a67-454f-ab71-cf22c31f5d09 tempest-CinderUnicodeTest-1666121266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f8052eff-4a67-454f-ab71-cf22c31f5d09 tempest-CinderUnicodeTest-1666121266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:55 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:10:55 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:55 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b34e3002-33c4-417b-8cb0-292fce58c8e8 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.472s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-b34e3002-33c4-417b-8cb0-292fce58c8e8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:55 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b34e3002-33c4-417b-8cb0-292fce58c8e8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Deleted volume successfully. Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b34e3002-33c4-417b-8cb0-292fce58c8e8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-0e9c0f1d-85f5-4365-b8f4-ea34090dd158-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:55 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f8052eff-4a67-454f-ab71-cf22c31f5d09 tempest-CinderUnicodeTest-1666121266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.421s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-f8052eff-4a67-454f-ab71-cf22c31f5d09 tempest-CinderUnicodeTest-1666121266 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:55 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f8052eff-4a67-454f-ab71-cf22c31f5d09 tempest-CinderUnicodeTest-1666121266 None] Deleted volume successfully. Feb 27 02:10:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f8052eff-4a67-454f-ab71-cf22c31f5d09 tempest-CinderUnicodeTest-1666121266 None] Lock "cinder-035f184a-2e66-469c-b6b4-799ea1d9f377-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "cinder-2959dcc1-7a16-4542-845b-e89d08df95a1-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-2959dcc1-7a16-4542-845b-e89d08df95a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "cinder-quobyte-ca91730b-96e4-4409-870c-cd289bb70cc7" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-quobyte-ca91730b-96e4-4409-870c-cd289bb70cc7" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "cinder-quobyte-2959dcc1-7a16-4542-845b-e89d08df95a1" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-quobyte-2959dcc1-7a16-4542-845b-e89d08df95a1" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Deleting offline snapshot 2959dcc1-7a16-4542-845b-e89d08df95a1 of volume ca91730b-96e4-4409-870c-cd289bb70cc7 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:10:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] snapshot_file for this snap is: volume-ca91730b-96e4-4409-870c-cd289bb70cc7.2959dcc1-7a16-4542-845b-e89d08df95a1 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:10:56 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f7147d-09d6-45de-ac61-af6604b2894b]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.2959dcc1-7a16-4542-845b-e89d08df95a1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:56 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.2959dcc1-7a16-4542-845b-e89d08df95a1 Feb 27 02:10:56 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:56 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.2959dcc1-7a16-4542-845b-e89d08df95a1" returned: 0 in 0.622s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca91730b-96e4-4409-870c-cd289bb70cc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:10:56 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ae42b0-098c-4dc2-800f-47afc9daf6a7]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:57 devstack sudo[90364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7 Feb 27 02:10:57 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:57 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7" returned: 0 in 0.548s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.2959dcc1-7a16-4542-845b-e89d08df95a1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:57 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.2959dcc1-7a16-4542-845b-e89d08df95a1 Feb 27 02:10:57 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:57 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.2959dcc1-7a16-4542-845b-e89d08df95a1" returned: 0 in 0.467s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.2959dcc1-7a16-4542-845b-e89d08df95a1 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:57 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.2959dcc1-7a16-4542-845b-e89d08df95a1 Feb 27 02:10:57 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:58 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7.2959dcc1-7a16-4542-845b-e89d08df95a1" returned: 0 in 0.412s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-quobyte-2959dcc1-7a16-4542-845b-e89d08df95a1" released by "_delete_snapshot" :: held 2.117s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-quobyte-ca91730b-96e4-4409-870c-cd289bb70cc7" released by "delete_snapshot" :: held 2.131s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:58 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Created reservations ['d633eab0-a217-4e43-89d5-537391c3692f', 'd1f1aeaf-c552-4cc6-abc9-618a07b881fe', '1d29f8fd-0114-44a9-91a3-df418120150f', '0b95da01-cf8d-4f83-b260-0c9ff97eb3cf'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:58 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Delete snapshot completed successfully. Feb 27 02:10:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-9889225a-8f0a-4e00-8d6f-9b661435e5a8 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-2959dcc1-7a16-4542-845b-e89d08df95a1-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2c26a13a-de0b-4c08-b3cb-54abf2475276 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "cinder-ca91730b-96e4-4409-870c-cd289bb70cc7-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2c26a13a-de0b-4c08-b3cb-54abf2475276 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-ca91730b-96e4-4409-870c-cd289bb70cc7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2c26a13a-de0b-4c08-b3cb-54abf2475276 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "cinder-quobyte-ca91730b-96e4-4409-870c-cd289bb70cc7" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2c26a13a-de0b-4c08-b3cb-54abf2475276 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-quobyte-ca91730b-96e4-4409-870c-cd289bb70cc7" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:59 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[7009d402-7f78-4162-88a5-ef25b7943fb3]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2c26a13a-de0b-4c08-b3cb-54abf2475276 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:59 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7 Feb 27 02:10:59 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:00 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2c26a13a-de0b-4c08-b3cb-54abf2475276 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7" returned: 0 in 0.638s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2c26a13a-de0b-4c08-b3cb-54abf2475276 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:00 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7 Feb 27 02:11:00 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:00 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2c26a13a-de0b-4c08-b3cb-54abf2475276 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ca91730b-96e4-4409-870c-cd289bb70cc7" returned: 0 in 0.442s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2c26a13a-de0b-4c08-b3cb-54abf2475276 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-quobyte-ca91730b-96e4-4409-870c-cd289bb70cc7" released by "delete_volume" :: held 1.122s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:00 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-2c26a13a-de0b-4c08-b3cb-54abf2475276 tempest-CreateVolumesFromSnapshotTest-596258211 None] Created reservations ['551b675b-df2a-45f0-9358-90f653306159', '8ea4e16d-5b07-4a5c-8bb3-8243187d6139', '561bd7d6-dcf6-438c-b3e1-36632cebc004', '778c8d4e-1cd1-4f3b-9f14-181932c14a25'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2c26a13a-de0b-4c08-b3cb-54abf2475276 tempest-CreateVolumesFromSnapshotTest-596258211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2c26a13a-de0b-4c08-b3cb-54abf2475276 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:00 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2c26a13a-de0b-4c08-b3cb-54abf2475276 tempest-CreateVolumesFromSnapshotTest-596258211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:00 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2c26a13a-de0b-4c08-b3cb-54abf2475276 tempest-CreateVolumesFromSnapshotTest-596258211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2c26a13a-de0b-4c08-b3cb-54abf2475276 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2c26a13a-de0b-4c08-b3cb-54abf2475276 tempest-CreateVolumesFromSnapshotTest-596258211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:00 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:11:00 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:01 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2c26a13a-de0b-4c08-b3cb-54abf2475276 tempest-CreateVolumesFromSnapshotTest-596258211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.456s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:01 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-2c26a13a-de0b-4c08-b3cb-54abf2475276 tempest-CreateVolumesFromSnapshotTest-596258211 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:01 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2c26a13a-de0b-4c08-b3cb-54abf2475276 tempest-CreateVolumesFromSnapshotTest-596258211 None] Deleted volume successfully. Feb 27 02:11:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-2c26a13a-de0b-4c08-b3cb-54abf2475276 tempest-CreateVolumesFromSnapshotTest-596258211 None] Lock "cinder-ca91730b-96e4-4409-870c-cd289bb70cc7-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Flow 'volume_create_manager' (314f3b9c-c20c-4ce0-b808-76bab2774d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc5944cd-99d1-4ad4-b0e6-0e5778e8af0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc5944cd-99d1-4ad4-b0e6-0e5778e8af0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1983537580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a1b487-fb0a-458f-9490-651b7e23ee58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d6400f674f49b2b770e494aef56e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:04Z,use_quota=True,user_id='3bffb01147e0444daa5cea081c60e2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66756de-d260-4b09-a58f-a3226880a48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66756de-d260-4b09-a58f-a3226880a48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c97fde6-a5c7-493c-9909-b485c0a36134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c97fde6-a5c7-493c-9909-b485c0a36134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58a1b487-fb0a-458f-9490-651b7e23ee58', 'volume_name': 'volume-58a1b487-fb0a-458f-9490-651b7e23ee58', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f89d4abe-1ea7-4c44-a350-621dbba0f888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f89d4abe-1ea7-4c44-a350-621dbba0f888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d3e393-83f4-4e55-a74c-30703565c566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:03 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Volume 58a1b487-fb0a-458f-9490-651b7e23ee58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58a1b487-fb0a-458f-9490-651b7e23ee58', 'volume_size': 1} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1983537580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a1b487-fb0a-458f-9490-651b7e23ee58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d6400f674f49b2b770e494aef56e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:04Z,use_quota=True,user_id='3bffb01147e0444daa5cea081c60e2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Creating volume 58a1b487-fb0a-458f-9490-651b7e23ee58 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:03 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:11:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-58a1b487-fb0a-458f-9490-651b7e23ee58 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:03 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-58a1b487-fb0a-458f-9490-651b7e23ee58 1073741824 Feb 27 02:11:03 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:04 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-58a1b487-fb0a-458f-9490-651b7e23ee58 1073741824" returned: 0 in 0.522s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-58a1b487-fb0a-458f-9490-651b7e23ee58 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:04 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-58a1b487-fb0a-458f-9490-651b7e23ee58 Feb 27 02:11:04 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:04 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-58a1b487-fb0a-458f-9490-651b7e23ee58" returned: 0 in 0.456s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:04 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d3e393-83f4-4e55-a74c-30703565c566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58a1b487-fb0a-458f-9490-651b7e23ee58', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2662c97b-2ac2-4812-b8e6-e81b832f2fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:04 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Volume volume-58a1b487-fb0a-458f-9490-651b7e23ee58 (58a1b487-fb0a-458f-9490-651b7e23ee58): created successfully Feb 27 02:11:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2662c97b-2ac2-4812-b8e6-e81b832f2fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Flow 'volume_create_manager' (314f3b9c-c20c-4ce0-b808-76bab2774d51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:04 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ae7f675b-66b0-4089-b424-b0d9486fe1cf tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Created volume successfully. Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Flow 'volume_create_manager' (9aba243d-feac-4eb5-ad8a-44ad8953dec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab031aa0-a07f-4fb0-82cf-591613508c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab031aa0-a07f-4fb0-82cf-591613508c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-736614185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9e12c8-6041-4929-b9da-37170c0304ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d6400f674f49b2b770e494aef56e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:06Z,use_quota=True,user_id='3bffb01147e0444daa5cea081c60e2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebfe27f-1f83-4234-bdab-a62e2a50380b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebfe27f-1f83-4234-bdab-a62e2a50380b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5121bae5-3633-42b4-add6-25739bb35fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5121bae5-3633-42b4-add6-25739bb35fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d9e12c8-6041-4929-b9da-37170c0304ac', 'volume_name': 'volume-5d9e12c8-6041-4929-b9da-37170c0304ac', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10df789c-65af-4f13-846a-a44f8beeca47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10df789c-65af-4f13-846a-a44f8beeca47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa620d9-aa71-43a7-a416-d38b9036ff62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:06 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Volume 5d9e12c8-6041-4929-b9da-37170c0304ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d9e12c8-6041-4929-b9da-37170c0304ac', 'volume_size': 1} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-736614185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9e12c8-6041-4929-b9da-37170c0304ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d6400f674f49b2b770e494aef56e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:06Z,use_quota=True,user_id='3bffb01147e0444daa5cea081c60e2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Creating volume 5d9e12c8-6041-4929-b9da-37170c0304ac {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:06 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d9e12c8-6041-4929-b9da-37170c0304ac 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:06 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d9e12c8-6041-4929-b9da-37170c0304ac 1073741824 Feb 27 02:11:06 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Flow 'volume_create_manager' (f3b28abf-b6ce-4909-a5e9-624aa146bcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78bf086e-ed4a-4f8b-9f1d-bd44c6be49e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78bf086e-ed4a-4f8b-9f1d-bd44c6be49e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-746612370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c8f5c12-35e7-4a73-b87a-b90129cbd589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d6400f674f49b2b770e494aef56e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:06Z,use_quota=True,user_id='3bffb01147e0444daa5cea081c60e2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63dc9f1-69ca-4c9e-a13f-27304602732d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63dc9f1-69ca-4c9e-a13f-27304602732d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c89a1eea-1c63-4636-b739-f1b5a318e978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c89a1eea-1c63-4636-b739-f1b5a318e978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c8f5c12-35e7-4a73-b87a-b90129cbd589', 'volume_name': 'volume-3c8f5c12-35e7-4a73-b87a-b90129cbd589', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d4bd53-c67d-4e82-a22d-1200ed5d1db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d4bd53-c67d-4e82-a22d-1200ed5d1db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c24b784-d4be-477d-94cf-2b1be9a37d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:06 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Volume 3c8f5c12-35e7-4a73-b87a-b90129cbd589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c8f5c12-35e7-4a73-b87a-b90129cbd589', 'volume_size': 1} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Flow 'volume_create_manager' (bd0992a5-1c76-44e2-a508-e04df136aba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e49dc3bb-e067-4111-b077-aabb380b0e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e49dc3bb-e067-4111-b077-aabb380b0e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-490295201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d0f0b9-8169-4b58-b26b-a6520f20fe5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d6400f674f49b2b770e494aef56e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:07Z,use_quota=True,user_id='3bffb01147e0444daa5cea081c60e2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669e3648-125a-43cb-90ed-a874dd1b197c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669e3648-125a-43cb-90ed-a874dd1b197c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4113ad-25e0-44de-b265-445df5db563d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4113ad-25e0-44de-b265-445df5db563d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d0f0b9-8169-4b58-b26b-a6520f20fe5f', 'volume_name': 'volume-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f43e325e-b88e-43fb-b848-86c372092ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f43e325e-b88e-43fb-b848-86c372092ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74ab821-5187-41a2-bea9-d1c1f34d5821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:06 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Volume d8d0f0b9-8169-4b58-b26b-a6520f20fe5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f', 'volume_size': 1} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:06 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d9e12c8-6041-4929-b9da-37170c0304ac 1073741824" returned: 0 in 0.700s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d9e12c8-6041-4929-b9da-37170c0304ac {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:06 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d9e12c8-6041-4929-b9da-37170c0304ac Feb 27 02:11:06 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Flow 'volume_create_manager' (eb8564b5-7c0c-42d6-abd9-4a04cc280de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76d9d97-69e1-4c5a-94e7-a215feb56972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76d9d97-69e1-4c5a-94e7-a215feb56972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1558157257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1932d553-10b6-4ae9-975f-82817e3d32a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d6400f674f49b2b770e494aef56e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:07Z,use_quota=True,user_id='3bffb01147e0444daa5cea081c60e2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6c810d-7058-4a45-bbf8-1354a41af604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6c810d-7058-4a45-bbf8-1354a41af604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65656594-dbef-4e25-98b9-372482b6bbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65656594-dbef-4e25-98b9-372482b6bbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1932d553-10b6-4ae9-975f-82817e3d32a9', 'volume_name': 'volume-1932d553-10b6-4ae9-975f-82817e3d32a9', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb73ffa3-67d1-4046-a696-5abada99e208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb73ffa3-67d1-4046-a696-5abada99e208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d1d032-7fbb-41f1-9b3f-565232d8c9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:07 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Volume 1932d553-10b6-4ae9-975f-82817e3d32a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1932d553-10b6-4ae9-975f-82817e3d32a9', 'volume_size': 1} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Flow 'volume_create_manager' (42a2b740-0d19-4615-8fd7-816dc77ce487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47855e2f-91f8-42ba-aab8-a7d1e4fc5871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47855e2f-91f8-42ba-aab8-a7d1e4fc5871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-283081292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef67634-9502-4bd3-b471-58b1cdfb8912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d6400f674f49b2b770e494aef56e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:07Z,use_quota=True,user_id='3bffb01147e0444daa5cea081c60e2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a36e346-454e-4cce-9b2d-d9faec4725df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a36e346-454e-4cce-9b2d-d9faec4725df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06d9141-6a19-4450-9e54-7d06a9c1b9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06d9141-6a19-4450-9e54-7d06a9c1b9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ef67634-9502-4bd3-b471-58b1cdfb8912', 'volume_name': 'volume-1ef67634-9502-4bd3-b471-58b1cdfb8912', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df925477-2d46-44d7-bfc0-3e604e793968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df925477-2d46-44d7-bfc0-3e604e793968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0a760d-9239-4d3a-a358-91ec9951c5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:07 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Volume 1ef67634-9502-4bd3-b471-58b1cdfb8912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ef67634-9502-4bd3-b471-58b1cdfb8912', 'volume_size': 1} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:07 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d9e12c8-6041-4929-b9da-37170c0304ac" returned: 0 in 0.531s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-746612370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c8f5c12-35e7-4a73-b87a-b90129cbd589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d6400f674f49b2b770e494aef56e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:06Z,use_quota=True,user_id='3bffb01147e0444daa5cea081c60e2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Creating volume 3c8f5c12-35e7-4a73-b87a-b90129cbd589 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:07 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3c8f5c12-35e7-4a73-b87a-b90129cbd589 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa620d9-aa71-43a7-a416-d38b9036ff62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d9e12c8-6041-4929-b9da-37170c0304ac', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:07 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3c8f5c12-35e7-4a73-b87a-b90129cbd589 1073741824 Feb 27 02:11:07 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f20d695-1893-4d19-92aa-32b8e93d6874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:07 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Volume volume-5d9e12c8-6041-4929-b9da-37170c0304ac (5d9e12c8-6041-4929-b9da-37170c0304ac): created successfully Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f20d695-1893-4d19-92aa-32b8e93d6874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Flow 'volume_create_manager' (9aba243d-feac-4eb5-ad8a-44ad8953dec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:07 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-bdb5ee68-4dc5-462d-800c-3f814f9c6a96 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Created volume successfully. Feb 27 02:11:08 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3c8f5c12-35e7-4a73-b87a-b90129cbd589 1073741824" returned: 0 in 0.550s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3c8f5c12-35e7-4a73-b87a-b90129cbd589 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:08 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3c8f5c12-35e7-4a73-b87a-b90129cbd589 Feb 27 02:11:08 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:08 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3c8f5c12-35e7-4a73-b87a-b90129cbd589" returned: 0 in 0.470s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.803s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-490295201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d0f0b9-8169-4b58-b26b-a6520f20fe5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d6400f674f49b2b770e494aef56e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:07Z,use_quota=True,user_id='3bffb01147e0444daa5cea081c60e2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Creating volume d8d0f0b9-8169-4b58-b26b-a6520f20fe5f {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:08 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:08 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:11:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c24b784-d4be-477d-94cf-2b1be9a37d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c8f5c12-35e7-4a73-b87a-b90129cbd589', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:08 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f 1073741824 Feb 27 02:11:08 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b96914-b91b-438f-bd67-5d108ae910b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:08 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Volume volume-3c8f5c12-35e7-4a73-b87a-b90129cbd589 (3c8f5c12-35e7-4a73-b87a-b90129cbd589): created successfully Feb 27 02:11:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b96914-b91b-438f-bd67-5d108ae910b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Flow 'volume_create_manager' (f3b28abf-b6ce-4909-a5e9-624aa146bcaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:08 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d42680c6-ff2c-49ec-8a9d-1d9af9ff64e9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Created volume successfully. Feb 27 02:11:09 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f 1073741824" returned: 0 in 0.576s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:09 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f Feb 27 02:11:09 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:09 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f" returned: 0 in 0.555s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.570s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1558157257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1932d553-10b6-4ae9-975f-82817e3d32a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d6400f674f49b2b770e494aef56e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:07Z,use_quota=True,user_id='3bffb01147e0444daa5cea081c60e2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Creating volume 1932d553-10b6-4ae9-975f-82817e3d32a9 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:09 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:09 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:11:09 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1932d553-10b6-4ae9-975f-82817e3d32a9 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74ab821-5187-41a2-bea9-d1c1f34d5821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1d6328-14bb-48f2-9ae3-bf8061e09d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:09 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1932d553-10b6-4ae9-975f-82817e3d32a9 1073741824 Feb 27 02:11:09 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:09 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Volume volume-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f (d8d0f0b9-8169-4b58-b26b-a6520f20fe5f): created successfully Feb 27 02:11:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1d6328-14bb-48f2-9ae3-bf8061e09d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:09 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Flow 'volume_create_manager' (bd0992a5-1c76-44e2-a508-e04df136aba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:09 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-272faeb0-9508-413f-926b-c283aaefc5f6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Created volume successfully. Feb 27 02:11:10 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1932d553-10b6-4ae9-975f-82817e3d32a9 1073741824" returned: 0 in 0.628s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1932d553-10b6-4ae9-975f-82817e3d32a9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:10 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1932d553-10b6-4ae9-975f-82817e3d32a9 Feb 27 02:11:10 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:10 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1932d553-10b6-4ae9-975f-82817e3d32a9" returned: 0 in 0.475s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.484s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-283081292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef67634-9502-4bd3-b471-58b1cdfb8912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d6400f674f49b2b770e494aef56e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:07Z,use_quota=True,user_id='3bffb01147e0444daa5cea081c60e2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Creating volume 1ef67634-9502-4bd3-b471-58b1cdfb8912 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:10 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:10 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:11:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ef67634-9502-4bd3-b471-58b1cdfb8912 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:10 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ef67634-9502-4bd3-b471-58b1cdfb8912 1073741824 Feb 27 02:11:10 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d1d032-7fbb-41f1-9b3f-565232d8c9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1932d553-10b6-4ae9-975f-82817e3d32a9', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1a1227-1b01-4cda-b098-6323192515c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:10 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Volume volume-1932d553-10b6-4ae9-975f-82817e3d32a9 (1932d553-10b6-4ae9-975f-82817e3d32a9): created successfully Feb 27 02:11:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1a1227-1b01-4cda-b098-6323192515c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:10 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Flow 'volume_create_manager' (eb8564b5-7c0c-42d6-abd9-4a04cc280de3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:10 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7cfdd7da-8712-42aa-9473-271869710315 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Created volume successfully. Feb 27 02:11:11 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ef67634-9502-4bd3-b471-58b1cdfb8912 1073741824" returned: 0 in 0.523s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ef67634-9502-4bd3-b471-58b1cdfb8912 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:11 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ef67634-9502-4bd3-b471-58b1cdfb8912 Feb 27 02:11:11 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:11 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ef67634-9502-4bd3-b471-58b1cdfb8912" returned: 0 in 0.466s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0a760d-9239-4d3a-a358-91ec9951c5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ef67634-9502-4bd3-b471-58b1cdfb8912', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3a4979-9fbe-4f4d-a689-ee46dd5f04c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:11 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Volume volume-1ef67634-9502-4bd3-b471-58b1cdfb8912 (1ef67634-9502-4bd3-b471-58b1cdfb8912): created successfully Feb 27 02:11:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3a4979-9fbe-4f4d-a689-ee46dd5f04c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:11 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Flow 'volume_create_manager' (42a2b740-0d19-4615-8fd7-816dc77ce487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:11 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-0e2787f8-fd2a-4ad3-9280-bb193792a740 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Created volume successfully. Feb 27 02:11:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8054cb20-2e39-4d1d-9668-f9553ca519ae tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "cinder-1ef67634-9502-4bd3-b471-58b1cdfb8912-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8054cb20-2e39-4d1d-9668-f9553ca519ae tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-1ef67634-9502-4bd3-b471-58b1cdfb8912-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8054cb20-2e39-4d1d-9668-f9553ca519ae tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "cinder-quobyte-1ef67634-9502-4bd3-b471-58b1cdfb8912" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8054cb20-2e39-4d1d-9668-f9553ca519ae tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-quobyte-1ef67634-9502-4bd3-b471-58b1cdfb8912" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:12 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9665d7d4-242b-4837-b033-45a466e461f8]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8054cb20-2e39-4d1d-9668-f9553ca519ae tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ef67634-9502-4bd3-b471-58b1cdfb8912 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:13 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ef67634-9502-4bd3-b471-58b1cdfb8912 Feb 27 02:11:13 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:13 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8054cb20-2e39-4d1d-9668-f9553ca519ae tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ef67634-9502-4bd3-b471-58b1cdfb8912" returned: 0 in 0.513s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8054cb20-2e39-4d1d-9668-f9553ca519ae tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ef67634-9502-4bd3-b471-58b1cdfb8912 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:13 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ef67634-9502-4bd3-b471-58b1cdfb8912 Feb 27 02:11:13 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:13 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8054cb20-2e39-4d1d-9668-f9553ca519ae tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ef67634-9502-4bd3-b471-58b1cdfb8912" returned: 0 in 0.400s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:13 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8054cb20-2e39-4d1d-9668-f9553ca519ae tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-quobyte-1ef67634-9502-4bd3-b471-58b1cdfb8912" released by "delete_volume" :: held 0.945s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:13 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-8054cb20-2e39-4d1d-9668-f9553ca519ae tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Created reservations ['d9401ccd-78c8-48d5-810c-799f58825302', 'd42d451e-7501-402a-ae13-887aa5fd35aa', '385df23b-432c-4149-b71e-9d4bbdc38cea', '6dd51c39-08aa-474c-8fd5-92df51163c62'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8054cb20-2e39-4d1d-9668-f9553ca519ae tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8054cb20-2e39-4d1d-9668-f9553ca519ae tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8054cb20-2e39-4d1d-9668-f9553ca519ae tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8054cb20-2e39-4d1d-9668-f9553ca519ae tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8054cb20-2e39-4d1d-9668-f9553ca519ae tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8054cb20-2e39-4d1d-9668-f9553ca519ae tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:13 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:11:14 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7f611385-ed7b-4a67-8859-2f40ccd305ab tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "cinder-1932d553-10b6-4ae9-975f-82817e3d32a9-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7f611385-ed7b-4a67-8859-2f40ccd305ab tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-1932d553-10b6-4ae9-975f-82817e3d32a9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7f611385-ed7b-4a67-8859-2f40ccd305ab tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "cinder-quobyte-1932d553-10b6-4ae9-975f-82817e3d32a9" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7f611385-ed7b-4a67-8859-2f40ccd305ab tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-quobyte-1932d553-10b6-4ae9-975f-82817e3d32a9" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:14 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[871eb7d3-2813-48e9-9a01-8229085d53f3]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7f611385-ed7b-4a67-8859-2f40ccd305ab tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1932d553-10b6-4ae9-975f-82817e3d32a9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:14 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1932d553-10b6-4ae9-975f-82817e3d32a9 Feb 27 02:11:14 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:14 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8054cb20-2e39-4d1d-9668-f9553ca519ae tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:14 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-8054cb20-2e39-4d1d-9668-f9553ca519ae tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:14 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8054cb20-2e39-4d1d-9668-f9553ca519ae tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Deleted volume successfully. Feb 27 02:11:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8054cb20-2e39-4d1d-9668-f9553ca519ae tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-1ef67634-9502-4bd3-b471-58b1cdfb8912-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:14 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7f611385-ed7b-4a67-8859-2f40ccd305ab tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1932d553-10b6-4ae9-975f-82817e3d32a9" returned: 0 in 0.604s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7f611385-ed7b-4a67-8859-2f40ccd305ab tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1932d553-10b6-4ae9-975f-82817e3d32a9 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:14 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1932d553-10b6-4ae9-975f-82817e3d32a9 Feb 27 02:11:14 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:15 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7f611385-ed7b-4a67-8859-2f40ccd305ab tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1932d553-10b6-4ae9-975f-82817e3d32a9" returned: 0 in 0.474s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7f611385-ed7b-4a67-8859-2f40ccd305ab tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-quobyte-1932d553-10b6-4ae9-975f-82817e3d32a9" released by "delete_volume" :: held 1.112s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:15 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-7f611385-ed7b-4a67-8859-2f40ccd305ab tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Created reservations ['477e429f-3349-4b8d-94e4-9ec3585b97e9', '31d22575-f850-4579-b7b3-ee073fba3acf', 'cfc306c2-edf8-4e32-a3f1-eeb3c4daf084', '7123ddf1-71b7-4b16-935b-6d19a0a26223'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7f611385-ed7b-4a67-8859-2f40ccd305ab tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7f611385-ed7b-4a67-8859-2f40ccd305ab tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7f611385-ed7b-4a67-8859-2f40ccd305ab tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7f611385-ed7b-4a67-8859-2f40ccd305ab tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7f611385-ed7b-4a67-8859-2f40ccd305ab tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7f611385-ed7b-4a67-8859-2f40ccd305ab tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:15 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:11:15 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:15 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7f611385-ed7b-4a67-8859-2f40ccd305ab tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.412s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:15 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-7f611385-ed7b-4a67-8859-2f40ccd305ab tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:15 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7f611385-ed7b-4a67-8859-2f40ccd305ab tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Deleted volume successfully. Feb 27 02:11:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7f611385-ed7b-4a67-8859-2f40ccd305ab tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-1932d553-10b6-4ae9-975f-82817e3d32a9-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5c8d96c5-358d-4916-8cea-2812b01bbc0a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "cinder-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5c8d96c5-358d-4916-8cea-2812b01bbc0a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5c8d96c5-358d-4916-8cea-2812b01bbc0a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "cinder-quobyte-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5c8d96c5-358d-4916-8cea-2812b01bbc0a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-quobyte-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:16 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf3c5a4-3831-404c-a888-c0181d7ecdf4]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5c8d96c5-358d-4916-8cea-2812b01bbc0a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:16 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f Feb 27 02:11:16 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:16 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5c8d96c5-358d-4916-8cea-2812b01bbc0a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f" returned: 0 in 0.663s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5c8d96c5-358d-4916-8cea-2812b01bbc0a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:16 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f Feb 27 02:11:16 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:17 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5c8d96c5-358d-4916-8cea-2812b01bbc0a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f" returned: 0 in 0.573s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5c8d96c5-358d-4916-8cea-2812b01bbc0a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-quobyte-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f" released by "delete_volume" :: held 1.266s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:17 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-5c8d96c5-358d-4916-8cea-2812b01bbc0a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Created reservations ['976f025d-dbc3-42b1-b452-32ae0c7008c8', 'b6b20159-5a6c-4000-8623-19f19ca68255', '203f60a4-b08d-4cea-968d-f396b60b571f', '0f49801e-9b62-436d-8e45-ff6c916e944c'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5c8d96c5-358d-4916-8cea-2812b01bbc0a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5c8d96c5-358d-4916-8cea-2812b01bbc0a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5c8d96c5-358d-4916-8cea-2812b01bbc0a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5c8d96c5-358d-4916-8cea-2812b01bbc0a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5c8d96c5-358d-4916-8cea-2812b01bbc0a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5c8d96c5-358d-4916-8cea-2812b01bbc0a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:17 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:11:17 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:18 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5c8d96c5-358d-4916-8cea-2812b01bbc0a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.488s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:18 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-5c8d96c5-358d-4916-8cea-2812b01bbc0a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:18 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-5c8d96c5-358d-4916-8cea-2812b01bbc0a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Deleted volume successfully. Feb 27 02:11:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5c8d96c5-358d-4916-8cea-2812b01bbc0a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-d8d0f0b9-8169-4b58-b26b-a6520f20fe5f-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-00a22796-d14b-4ac1-8ccc-5044aa9b29b6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "cinder-3c8f5c12-35e7-4a73-b87a-b90129cbd589-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-00a22796-d14b-4ac1-8ccc-5044aa9b29b6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-3c8f5c12-35e7-4a73-b87a-b90129cbd589-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-00a22796-d14b-4ac1-8ccc-5044aa9b29b6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "cinder-quobyte-3c8f5c12-35e7-4a73-b87a-b90129cbd589" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-00a22796-d14b-4ac1-8ccc-5044aa9b29b6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-quobyte-3c8f5c12-35e7-4a73-b87a-b90129cbd589" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:18 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f360ada9-92b6-4241-89a6-638ac850670a]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-00a22796-d14b-4ac1-8ccc-5044aa9b29b6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3c8f5c12-35e7-4a73-b87a-b90129cbd589 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:18 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3c8f5c12-35e7-4a73-b87a-b90129cbd589 Feb 27 02:11:18 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:18 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-00a22796-d14b-4ac1-8ccc-5044aa9b29b6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3c8f5c12-35e7-4a73-b87a-b90129cbd589" returned: 0 in 0.487s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-00a22796-d14b-4ac1-8ccc-5044aa9b29b6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3c8f5c12-35e7-4a73-b87a-b90129cbd589 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:18 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3c8f5c12-35e7-4a73-b87a-b90129cbd589 Feb 27 02:11:18 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:19 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-00a22796-d14b-4ac1-8ccc-5044aa9b29b6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-3c8f5c12-35e7-4a73-b87a-b90129cbd589" returned: 0 in 0.418s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-00a22796-d14b-4ac1-8ccc-5044aa9b29b6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-quobyte-3c8f5c12-35e7-4a73-b87a-b90129cbd589" released by "delete_volume" :: held 0.929s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:19 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-00a22796-d14b-4ac1-8ccc-5044aa9b29b6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Created reservations ['0a39bd9f-2201-47b9-852f-31c9d16ba478', '40b3fd73-2d15-409d-9ad1-1dbf3907ec49', '7b73d5cb-5184-4f06-82d0-ded23e43f392', '4da08431-7812-4a62-87fc-a5158c0861b5'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-00a22796-d14b-4ac1-8ccc-5044aa9b29b6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-00a22796-d14b-4ac1-8ccc-5044aa9b29b6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-00a22796-d14b-4ac1-8ccc-5044aa9b29b6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-00a22796-d14b-4ac1-8ccc-5044aa9b29b6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-00a22796-d14b-4ac1-8ccc-5044aa9b29b6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-00a22796-d14b-4ac1-8ccc-5044aa9b29b6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:19 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:11:19 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-25ad381c-ce67-45eb-9127-1fa526c5c5a9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "cinder-5d9e12c8-6041-4929-b9da-37170c0304ac-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-25ad381c-ce67-45eb-9127-1fa526c5c5a9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-5d9e12c8-6041-4929-b9da-37170c0304ac-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-25ad381c-ce67-45eb-9127-1fa526c5c5a9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "cinder-quobyte-5d9e12c8-6041-4929-b9da-37170c0304ac" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-25ad381c-ce67-45eb-9127-1fa526c5c5a9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-quobyte-5d9e12c8-6041-4929-b9da-37170c0304ac" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:19 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faca5cc-d42c-4db0-b7ad-8e1de47efd68]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-25ad381c-ce67-45eb-9127-1fa526c5c5a9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d9e12c8-6041-4929-b9da-37170c0304ac {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:19 devstack sudo[90486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d9e12c8-6041-4929-b9da-37170c0304ac Feb 27 02:11:19 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:20 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-00a22796-d14b-4ac1-8ccc-5044aa9b29b6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.537s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:20 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-00a22796-d14b-4ac1-8ccc-5044aa9b29b6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:20 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-00a22796-d14b-4ac1-8ccc-5044aa9b29b6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Deleted volume successfully. Feb 27 02:11:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-00a22796-d14b-4ac1-8ccc-5044aa9b29b6 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-3c8f5c12-35e7-4a73-b87a-b90129cbd589-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:20 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-25ad381c-ce67-45eb-9127-1fa526c5c5a9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d9e12c8-6041-4929-b9da-37170c0304ac" returned: 0 in 0.514s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-25ad381c-ce67-45eb-9127-1fa526c5c5a9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d9e12c8-6041-4929-b9da-37170c0304ac {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:20 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d9e12c8-6041-4929-b9da-37170c0304ac Feb 27 02:11:20 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:20 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-25ad381c-ce67-45eb-9127-1fa526c5c5a9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-5d9e12c8-6041-4929-b9da-37170c0304ac" returned: 0 in 0.433s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-25ad381c-ce67-45eb-9127-1fa526c5c5a9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-quobyte-5d9e12c8-6041-4929-b9da-37170c0304ac" released by "delete_volume" :: held 0.973s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:20 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-25ad381c-ce67-45eb-9127-1fa526c5c5a9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Created reservations ['dd28f8bc-3df0-4cee-8f3c-38f2633ae565', '9f43941f-f3b1-4e73-bc8b-c976a814b039', '4cbdb90e-ad35-456f-b0e6-470525173b0d', '9161d4b3-17a8-4934-a245-1d7ef4ca785c'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-25ad381c-ce67-45eb-9127-1fa526c5c5a9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-25ad381c-ce67-45eb-9127-1fa526c5c5a9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-25ad381c-ce67-45eb-9127-1fa526c5c5a9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-25ad381c-ce67-45eb-9127-1fa526c5c5a9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-25ad381c-ce67-45eb-9127-1fa526c5c5a9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-25ad381c-ce67-45eb-9127-1fa526c5c5a9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:20 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:11:20 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:21 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-25ad381c-ce67-45eb-9127-1fa526c5c5a9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.392s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:21 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-25ad381c-ce67-45eb-9127-1fa526c5c5a9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:21 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-25ad381c-ce67-45eb-9127-1fa526c5c5a9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Deleted volume successfully. Feb 27 02:11:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-25ad381c-ce67-45eb-9127-1fa526c5c5a9 tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-5d9e12c8-6041-4929-b9da-37170c0304ac-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ce0914ed-186f-4358-85b2-72088547483a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "cinder-58a1b487-fb0a-458f-9490-651b7e23ee58-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ce0914ed-186f-4358-85b2-72088547483a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-58a1b487-fb0a-458f-9490-651b7e23ee58-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ce0914ed-186f-4358-85b2-72088547483a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "cinder-quobyte-58a1b487-fb0a-458f-9490-651b7e23ee58" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ce0914ed-186f-4358-85b2-72088547483a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-quobyte-58a1b487-fb0a-458f-9490-651b7e23ee58" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:21 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[908afdd6-4262-4756-8c26-2258d724006e]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ce0914ed-186f-4358-85b2-72088547483a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-58a1b487-fb0a-458f-9490-651b7e23ee58 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:21 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-58a1b487-fb0a-458f-9490-651b7e23ee58 Feb 27 02:11:21 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:22 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ce0914ed-186f-4358-85b2-72088547483a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-58a1b487-fb0a-458f-9490-651b7e23ee58" returned: 0 in 0.565s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ce0914ed-186f-4358-85b2-72088547483a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-58a1b487-fb0a-458f-9490-651b7e23ee58 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:22 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-58a1b487-fb0a-458f-9490-651b7e23ee58 Feb 27 02:11:22 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:22 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ce0914ed-186f-4358-85b2-72088547483a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-58a1b487-fb0a-458f-9490-651b7e23ee58" returned: 0 in 0.485s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ce0914ed-186f-4358-85b2-72088547483a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-quobyte-58a1b487-fb0a-458f-9490-651b7e23ee58" released by "delete_volume" :: held 1.075s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:22 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ce0914ed-186f-4358-85b2-72088547483a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Created reservations ['ab04426e-056c-4403-9bd6-f942c62dadb8', 'f9f6ab8e-7be3-4df5-9117-bca28545a37b', '3ba6ce9f-5a42-4588-b5a7-bf4f7d03ff17', 'bfa10319-a182-4f7f-8127-8eec93479000'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ce0914ed-186f-4358-85b2-72088547483a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ce0914ed-186f-4358-85b2-72088547483a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ce0914ed-186f-4358-85b2-72088547483a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:22 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-ce0914ed-186f-4358-85b2-72088547483a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-ce0914ed-186f-4358-85b2-72088547483a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ce0914ed-186f-4358-85b2-72088547483a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:22 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:11:22 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:23 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ce0914ed-186f-4358-85b2-72088547483a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.399s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:23 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-ce0914ed-186f-4358-85b2-72088547483a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:23 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ce0914ed-186f-4358-85b2-72088547483a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Deleted volume successfully. Feb 27 02:11:23 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ce0914ed-186f-4358-85b2-72088547483a tempest-CreateVolumesFromSourceVolumeTest-464245755 None] Lock "cinder-58a1b487-fb0a-458f-9490-651b7e23ee58-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:30 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:11:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:30 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:11:30 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:31 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.543s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:31 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Flow 'volume_create_manager' (20961258-c728-43df-a56e-745c2da0b35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988eb853-2148-423e-b9ab-2148e2b4f25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988eb853-2148-423e-b9ab-2148e2b4f25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-205071041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25cbc5bc-d41a-4290-ab1d-dc9ad730d72c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b15192b8a054010b39de25ebc41e05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:32Z,use_quota=True,user_id='c820ea5ce0654efa9623179e43af2ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ab122a-0136-4517-9f05-fc80467381ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3ab122a-0136-4517-9f05-fc80467381ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d776dc11-1029-46ec-837a-33d2bb4df88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d776dc11-1029-46ec-837a-33d2bb4df88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25cbc5bc-d41a-4290-ab1d-dc9ad730d72c', 'volume_name': 'volume-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b19d25-c71a-4e6f-9e02-85d8927a9ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b19d25-c71a-4e6f-9e02-85d8927a9ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5abe41f-99bb-4bb0-b31e-3ddb619beab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Volume 25cbc5bc-d41a-4290-ab1d-dc9ad730d72c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c', 'volume_size': 1} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-205071041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25cbc5bc-d41a-4290-ab1d-dc9ad730d72c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b15192b8a054010b39de25ebc41e05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:32Z,use_quota=True,user_id='c820ea5ce0654efa9623179e43af2ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Creating volume 25cbc5bc-d41a-4290-ab1d-dc9ad730d72c {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:32 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:32 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c 1073741824 Feb 27 02:11:32 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Flow 'volume_create_manager' (d207ba97-09a1-4a8d-a690-4af67795f61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d54f748-2c7b-45a1-b177-fbfc4538a547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d54f748-2c7b-45a1-b177-fbfc4538a547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-827014352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecfd1149-e4f6-466b-aadc-3e68159f95ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e9fd887f1904a0ab14e58c1cbc19cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:32Z,use_quota=True,user_id='915fc4ff56ad4380b75568109f562ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e52903-7135-49f5-a0d1-ce884341232e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e52903-7135-49f5-a0d1-ce884341232e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34229b6-c61f-4604-bcc5-4a39d9db7ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34229b6-c61f-4604-bcc5-4a39d9db7ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecfd1149-e4f6-466b-aadc-3e68159f95ec', 'volume_name': 'volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140a7ee3-d36c-4f19-b2db-932b03e60fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (140a7ee3-d36c-4f19-b2db-932b03e60fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6975e5f-deb6-4943-be19-c6dc5233a2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Volume ecfd1149-e4f6-466b-aadc-3e68159f95ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec', 'volume_size': 1} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Flow 'volume_create_manager' (41298f53-3f87-4f94-99e4-7ff2d4239bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8801bb-2664-48a8-b35a-2c4283c581fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Flow 'volume_create_manager' (8152856b-3436-48bd-9be1-0c79523cf413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06bd301d-f456-4ee4-8867-a651ceae7269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8801bb-2664-48a8-b35a-2c4283c581fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-939101043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a39dcbe5-166f-441f-a46e-c27cee39d274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b15192b8a054010b39de25ebc41e05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:32Z,use_quota=True,user_id='c820ea5ce0654efa9623179e43af2ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7ec2db-7f38-4cd3-9bc5-0f6680137be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7ec2db-7f38-4cd3-9bc5-0f6680137be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e71fbbc7-c9c3-4897-951a-02c5db86506c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e71fbbc7-c9c3-4897-951a-02c5db86506c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a39dcbe5-166f-441f-a46e-c27cee39d274', 'volume_name': 'volume-a39dcbe5-166f-441f-a46e-c27cee39d274', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36353534-274f-4f9e-bdf3-46af4dabbff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36353534-274f-4f9e-bdf3-46af4dabbff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec9138d0-42fe-435c-a4a7-f60a665e642f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Volume a39dcbe5-166f-441f-a46e-c27cee39d274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a39dcbe5-166f-441f-a46e-c27cee39d274', 'volume_size': 1} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06bd301d-f456-4ee4-8867-a651ceae7269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-351483213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ceb1f8b-6475-41ed-8b42-c8eced43fc5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100c945a09e94175879f9d1bbc90fbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:32Z,use_quota=True,user_id='aca9dcef8f6d4819b8b5f2c243c1dae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55858776-71c5-4777-b9d1-e0b9be26e89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55858776-71c5-4777-b9d1-e0b9be26e89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7712b441-fba8-4205-896e-fe5750967898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7712b441-fba8-4205-896e-fe5750967898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ceb1f8b-6475-41ed-8b42-c8eced43fc5c', 'volume_name': 'volume-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393a8128-8f95-40e4-8776-b17ba1d18b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393a8128-8f95-40e4-8776-b17ba1d18b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef4f0cf-fdc7-48bc-b878-ef5e4dd86e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Volume 1ceb1f8b-6475-41ed-8b42-c8eced43fc5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c', 'volume_size': 1} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Flow 'volume_create_manager' (e016a21c-5909-40d0-a489-1b0ca6a77609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64476cd-e0e9-48e3-b43a-fa9ee46231c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64476cd-e0e9-48e3-b43a-fa9ee46231c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-923914902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1604c609-c7e6-4542-b019-bd6cdff798fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b15192b8a054010b39de25ebc41e05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:33Z,use_quota=True,user_id='c820ea5ce0654efa9623179e43af2ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1a3b12-8a1c-410b-b74b-c16bf9e17d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1a3b12-8a1c-410b-b74b-c16bf9e17d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e74ea7b-882b-4b04-9db7-292de3f2a58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e74ea7b-882b-4b04-9db7-292de3f2a58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1604c609-c7e6-4542-b019-bd6cdff798fe', 'volume_name': 'volume-1604c609-c7e6-4542-b019-bd6cdff798fe', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a43aeda-25ad-48c3-a560-d122f7d86062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a43aeda-25ad-48c3-a560-d122f7d86062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b037bdbc-aeda-4af3-99ac-7742fcada323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Volume 1604c609-c7e6-4542-b019-bd6cdff798fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1604c609-c7e6-4542-b019-bd6cdff798fe', 'volume_size': 1} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Flow 'volume_create_manager' (111af94e-412d-4adc-8163-1eb4b7291baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54716d9c-c336-41e6-83ab-44b54825e9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54716d9c-c336-41e6-83ab-44b54825e9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-334886959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77522f8-9ed0-4463-9869-d55209a426de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b15192b8a054010b39de25ebc41e05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:33Z,use_quota=True,user_id='c820ea5ce0654efa9623179e43af2ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c871316f-6f12-4055-ad80-de67e1ff3b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c871316f-6f12-4055-ad80-de67e1ff3b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dada63e7-dd5d-4f89-8d70-3d7ad2cf4734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dada63e7-dd5d-4f89-8d70-3d7ad2cf4734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd77522f8-9ed0-4463-9869-d55209a426de', 'volume_name': 'volume-d77522f8-9ed0-4463-9869-d55209a426de', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6657b398-4bd1-4046-92f8-6b8905605977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6657b398-4bd1-4046-92f8-6b8905605977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df46db1b-f893-492c-93ab-f5ef378da3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:33 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Volume d77522f8-9ed0-4463-9869-d55209a426de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d77522f8-9ed0-4463-9869-d55209a426de', 'volume_size': 1} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Flow 'volume_create_manager' (c3966213-5ede-4e2e-b430-7d550ee398a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd833589-ed93-4165-b64c-1cc03dd780c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd833589-ed93-4165-b64c-1cc03dd780c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1772414948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62610036-a372-474b-b84e-eb7c24e7f8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b15192b8a054010b39de25ebc41e05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:33Z,use_quota=True,user_id='c820ea5ce0654efa9623179e43af2ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ddef9e-dbf2-4168-8e81-d677c53b9972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ddef9e-dbf2-4168-8e81-d677c53b9972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53d59d8-53cc-43ac-aa73-68107b267fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53d59d8-53cc-43ac-aa73-68107b267fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62610036-a372-474b-b84e-eb7c24e7f8c5', 'volume_name': 'volume-62610036-a372-474b-b84e-eb7c24e7f8c5', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa092de-f0eb-4f5c-a391-3fd61f322b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa092de-f0eb-4f5c-a391-3fd61f322b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4789557f-d4c7-4d47-8366-e566a6a018e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:33 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Volume 62610036-a372-474b-b84e-eb7c24e7f8c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62610036-a372-474b-b84e-eb7c24e7f8c5', 'volume_size': 1} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:33 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c 1073741824" returned: 0 in 0.834s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:33 devstack sudo[90559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c Feb 27 02:11:33 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:33 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c" returned: 0 in 0.474s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.197s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-827014352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecfd1149-e4f6-466b-aadc-3e68159f95ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e9fd887f1904a0ab14e58c1cbc19cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:32Z,use_quota=True,user_id='915fc4ff56ad4380b75568109f562ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Creating volume ecfd1149-e4f6-466b-aadc-3e68159f95ec {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:33 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5abe41f-99bb-4bb0-b31e-3ddb619beab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25304668-4757-4ebb-81f9-b0adaeb61ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:33 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec 1073741824 Feb 27 02:11:33 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:33 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Volume volume-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c (25cbc5bc-d41a-4290-ab1d-dc9ad730d72c): created successfully Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25304668-4757-4ebb-81f9-b0adaeb61ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:33 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Flow 'volume_create_manager' (20961258-c728-43df-a56e-745c2da0b35a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:33 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-75e476e4-671c-423d-bf64-7f5b06ca36c2 tempest-CreateVolumesFromImageTest-1178995007 None] Created volume successfully. Feb 27 02:11:34 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec 1073741824" returned: 0 in 0.786s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:34 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec Feb 27 02:11:34 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:35 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec" returned: 0 in 0.563s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.460s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-939101043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a39dcbe5-166f-441f-a46e-c27cee39d274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b15192b8a054010b39de25ebc41e05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:32Z,use_quota=True,user_id='c820ea5ce0654efa9623179e43af2ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Creating volume a39dcbe5-166f-441f-a46e-c27cee39d274 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:35 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a39dcbe5-166f-441f-a46e-c27cee39d274 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6975e5f-deb6-4943-be19-c6dc5233a2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576b62b5-eee6-416c-8451-4b9cd4ac881c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:35 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a39dcbe5-166f-441f-a46e-c27cee39d274 1073741824 Feb 27 02:11:35 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:35 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Volume volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec (ecfd1149-e4f6-466b-aadc-3e68159f95ec): created successfully Feb 27 02:11:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576b62b5-eee6-416c-8451-4b9cd4ac881c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:35 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Flow 'volume_create_manager' (d207ba97-09a1-4a8d-a690-4af67795f61d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:35 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-90ecabd0-e552-40cb-af74-6d945852e576 tempest-VolumeDependencyTests-1616200110 None] Created volume successfully. Feb 27 02:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-705bd5c1-fa6c-4f45-97db-436a849d1e04 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:35 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a39dcbe5-166f-441f-a46e-c27cee39d274 1073741824" returned: 0 in 0.701s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a39dcbe5-166f-441f-a46e-c27cee39d274 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:35 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a39dcbe5-166f-441f-a46e-c27cee39d274 Feb 27 02:11:35 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:36 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a39dcbe5-166f-441f-a46e-c27cee39d274" returned: 0 in 0.585s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.743s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-351483213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ceb1f8b-6475-41ed-8b42-c8eced43fc5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100c945a09e94175879f9d1bbc90fbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:32Z,use_quota=True,user_id='aca9dcef8f6d4819b8b5f2c243c1dae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Creating volume 1ceb1f8b-6475-41ed-8b42-c8eced43fc5c {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:36 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:11:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec9138d0-42fe-435c-a4a7-f60a665e642f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a39dcbe5-166f-441f-a46e-c27cee39d274', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567dd0f2-efdd-4653-91c1-961a363c69fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:36 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c 1073741824 Feb 27 02:11:36 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:36 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Volume volume-a39dcbe5-166f-441f-a46e-c27cee39d274 (a39dcbe5-166f-441f-a46e-c27cee39d274): created successfully Feb 27 02:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567dd0f2-efdd-4653-91c1-961a363c69fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:36 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Flow 'volume_create_manager' (41298f53-3f87-4f94-99e4-7ff2d4239bc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:36 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c8c8af31-cbae-4ea8-b91c-b3f191b26d2c tempest-CreateVolumesFromImageTest-1178995007 None] Created volume successfully. Feb 27 02:11:37 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c 1073741824" returned: 0 in 0.606s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:37 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c Feb 27 02:11:37 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:37 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c" returned: 0 in 0.429s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.719s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-923914902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1604c609-c7e6-4542-b019-bd6cdff798fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b15192b8a054010b39de25ebc41e05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:33Z,use_quota=True,user_id='c820ea5ce0654efa9623179e43af2ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Creating volume 1604c609-c7e6-4542-b019-bd6cdff798fe {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:37 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:37 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:11:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1604c609-c7e6-4542-b019-bd6cdff798fe 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef4f0cf-fdc7-48bc-b878-ef5e4dd86e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324b9710-fa20-4da6-8839-b1bb1f15d4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:37 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Volume volume-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c (1ceb1f8b-6475-41ed-8b42-c8eced43fc5c): created successfully Feb 27 02:11:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324b9710-fa20-4da6-8839-b1bb1f15d4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:37 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1604c609-c7e6-4542-b019-bd6cdff798fe 1073741824 Feb 27 02:11:37 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:37 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Flow 'volume_create_manager' (8152856b-3436-48bd-9be1-0c79523cf413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:37 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-4352a6f4-197c-4b24-a104-40d235f8756f tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Created volume successfully. Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:38 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Flow 'volume_create_manager' (3ce0f62f-cb84-4769-9399-6120616323fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abdc9ad-7dbc-4bd0-a848-d23100e1ccbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1604c609-c7e6-4542-b019-bd6cdff798fe 1073741824" returned: 0 in 0.619s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abdc9ad-7dbc-4bd0-a848-d23100e1ccbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2130822625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536653d2-6fb6-4765-baf6-4aa4c523b08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100c945a09e94175879f9d1bbc90fbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:38Z,use_quota=True,user_id='aca9dcef8f6d4819b8b5f2c243c1dae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11e3a9de-cf50-49a3-b426-b853259c1ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11e3a9de-cf50-49a3-b426-b853259c1ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3483038c-204a-403a-a534-7dfa9b7a5f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3483038c-204a-403a-a534-7dfa9b7a5f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '536653d2-6fb6-4765-baf6-4aa4c523b08c', 'volume_name': 'volume-536653d2-6fb6-4765-baf6-4aa4c523b08c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90baffb6-62e5-45c9-a162-6232ed576f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90baffb6-62e5-45c9-a162-6232ed576f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937c5359-fa38-4cf8-9fb0-66d9119dd0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Volume 536653d2-6fb6-4765-baf6-4aa4c523b08c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-536653d2-6fb6-4765-baf6-4aa4c523b08c', 'volume_size': 1} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1604c609-c7e6-4542-b019-bd6cdff798fe {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:38 devstack sudo[90632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1604c609-c7e6-4542-b019-bd6cdff798fe Feb 27 02:11:38 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Flow 'volume_create_manager' (39152672-4ef8-40f8-bf9e-e71643abdcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670cb66d-d652-431d-a9fe-acde39370a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670cb66d-d652-431d-a9fe-acde39370a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-66799281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a3acff-2e23-41c6-a5c3-9973da525a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100c945a09e94175879f9d1bbc90fbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:38Z,use_quota=True,user_id='aca9dcef8f6d4819b8b5f2c243c1dae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0638badc-189f-44a6-8f50-63eb640e0db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0638badc-189f-44a6-8f50-63eb640e0db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332a568e-1285-4c99-b24f-dee8b6356b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332a568e-1285-4c99-b24f-dee8b6356b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65a3acff-2e23-41c6-a5c3-9973da525a6f', 'volume_name': 'volume-65a3acff-2e23-41c6-a5c3-9973da525a6f', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd6a9040-dbb5-48c9-b09c-d7e6e8dfb922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd6a9040-dbb5-48c9-b09c-d7e6e8dfb922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b19c2c-aedd-40da-84df-e6ef9d4f2372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Volume 65a3acff-2e23-41c6-a5c3-9973da525a6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65a3acff-2e23-41c6-a5c3-9973da525a6f', 'volume_size': 1} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Flow 'volume_create_manager' (6125bda9-d637-44cc-92b9-a6eba6e98245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044ce45a-d894-4905-b067-9554ed1715fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044ce45a-d894-4905-b067-9554ed1715fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-90503466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8853e25-daac-45b6-b65f-c23dacd7a310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100c945a09e94175879f9d1bbc90fbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:39Z,use_quota=True,user_id='aca9dcef8f6d4819b8b5f2c243c1dae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4ff770-fafa-4873-8d4c-218d7d6721f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4ff770-fafa-4873-8d4c-218d7d6721f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca240b6c-2dcb-436a-9bcd-88c3aa73e521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca240b6c-2dcb-436a-9bcd-88c3aa73e521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8853e25-daac-45b6-b65f-c23dacd7a310', 'volume_name': 'volume-f8853e25-daac-45b6-b65f-c23dacd7a310', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4423e79-c80e-496c-858e-e849b0ced0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4423e79-c80e-496c-858e-e849b0ced0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401383aa-7c1b-4ae8-8d8a-f6a501323c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Volume f8853e25-daac-45b6-b65f-c23dacd7a310: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8853e25-daac-45b6-b65f-c23dacd7a310', 'volume_size': 1} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:38 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1604c609-c7e6-4542-b019-bd6cdff798fe" returned: 0 in 0.545s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.770s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-334886959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77522f8-9ed0-4463-9869-d55209a426de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b15192b8a054010b39de25ebc41e05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:33Z,use_quota=True,user_id='c820ea5ce0654efa9623179e43af2ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Creating volume d77522f8-9ed0-4463-9869-d55209a426de {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:38 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d77522f8-9ed0-4463-9869-d55209a426de 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b037bdbc-aeda-4af3-99ac-7742fcada323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1604c609-c7e6-4542-b019-bd6cdff798fe', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b84e10a-0aa7-4d64-88f8-53d9b1479d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d77522f8-9ed0-4463-9869-d55209a426de 1073741824 Feb 27 02:11:38 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:38 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Volume volume-1604c609-c7e6-4542-b019-bd6cdff798fe (1604c609-c7e6-4542-b019-bd6cdff798fe): created successfully Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b84e10a-0aa7-4d64-88f8-53d9b1479d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Flow 'volume_create_manager' (e016a21c-5909-40d0-a489-1b0ca6a77609) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:38 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-bd3ae8cc-1c56-4ae3-aa44-804eee41a3d5 tempest-CreateVolumesFromImageTest-1178995007 None] Created volume successfully. Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Flow 'volume_create_manager' (8cc3c65c-b8a2-4161-9f32-9569cdeef321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efaf1579-4b10-47ab-9ae6-1ac9d86fa7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efaf1579-4b10-47ab-9ae6-1ac9d86fa7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-881071137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be7fd5e9-3bd5-4459-a441-58b5e5c2a04c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100c945a09e94175879f9d1bbc90fbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:39Z,use_quota=True,user_id='aca9dcef8f6d4819b8b5f2c243c1dae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc93f07f-00cc-4d20-947a-56c3d89c56e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc93f07f-00cc-4d20-947a-56c3d89c56e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c9b4e7-2477-4636-b195-7bc2fcc961c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c9b4e7-2477-4636-b195-7bc2fcc961c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be7fd5e9-3bd5-4459-a441-58b5e5c2a04c', 'volume_name': 'volume-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f5a5c4-6a80-4e80-b311-2705a0aaec23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f5a5c4-6a80-4e80-b311-2705a0aaec23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d710362b-9839-4f3b-87ea-060678daeb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Volume be7fd5e9-3bd5-4459-a441-58b5e5c2a04c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c', 'volume_size': 1} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Flow 'volume_create_manager' (8b08473d-d972-4965-ae20-6b1d2d629fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfeb1f54-c92f-4e7c-b7a8-a586747bd5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfeb1f54-c92f-4e7c-b7a8-a586747bd5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1550087012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2639baf2-4669-46a6-a828-2adb63d93d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100c945a09e94175879f9d1bbc90fbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:39Z,use_quota=True,user_id='aca9dcef8f6d4819b8b5f2c243c1dae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177e4000-99c4-4f8e-9a7c-0ba782126152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177e4000-99c4-4f8e-9a7c-0ba782126152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d92332-dec9-4fda-9800-7753794eaa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d92332-dec9-4fda-9800-7753794eaa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2639baf2-4669-46a6-a828-2adb63d93d5a', 'volume_name': 'volume-2639baf2-4669-46a6-a828-2adb63d93d5a', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65318475-8bc9-46e6-82ba-aef38e0e3242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65318475-8bc9-46e6-82ba-aef38e0e3242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77da0db1-33f4-42e1-a241-09d533d980b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:39 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Volume 2639baf2-4669-46a6-a828-2adb63d93d5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2639baf2-4669-46a6-a828-2adb63d93d5a', 'volume_size': 1} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:39 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d77522f8-9ed0-4463-9869-d55209a426de 1073741824" returned: 0 in 0.696s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d77522f8-9ed0-4463-9869-d55209a426de {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:39 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d77522f8-9ed0-4463-9869-d55209a426de Feb 27 02:11:39 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:39 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d77522f8-9ed0-4463-9869-d55209a426de" returned: 0 in 0.462s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.739s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1772414948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62610036-a372-474b-b84e-eb7c24e7f8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b15192b8a054010b39de25ebc41e05b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:33Z,use_quota=True,user_id='c820ea5ce0654efa9623179e43af2ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Creating volume 62610036-a372-474b-b84e-eb7c24e7f8c5 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:39 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:11:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62610036-a372-474b-b84e-eb7c24e7f8c5 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df46db1b-f893-492c-93ab-f5ef378da3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d77522f8-9ed0-4463-9869-d55209a426de', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbb315c-5543-4ba5-adad-c2874e2dd44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:40 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62610036-a372-474b-b84e-eb7c24e7f8c5 1073741824 Feb 27 02:11:40 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:40 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Volume volume-d77522f8-9ed0-4463-9869-d55209a426de (d77522f8-9ed0-4463-9869-d55209a426de): created successfully Feb 27 02:11:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbb315c-5543-4ba5-adad-c2874e2dd44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:40 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Flow 'volume_create_manager' (111af94e-412d-4adc-8163-1eb4b7291baf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:40 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-6469bb7a-9dde-4f06-a5a6-b04ee0f0a17f tempest-CreateVolumesFromImageTest-1178995007 None] Created volume successfully. Feb 27 02:11:40 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62610036-a372-474b-b84e-eb7c24e7f8c5 1073741824" returned: 0 in 0.590s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62610036-a372-474b-b84e-eb7c24e7f8c5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:40 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62610036-a372-474b-b84e-eb7c24e7f8c5 Feb 27 02:11:40 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:41 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62610036-a372-474b-b84e-eb7c24e7f8c5" returned: 0 in 0.543s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-705bd5c1-fa6c-4f45-97db-436a849d1e04 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.405s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4789557f-d4c7-4d47-8366-e566a6a018e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62610036-a372-474b-b84e-eb7c24e7f8c5', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39abe4aa-0d9b-4686-ab0e-d8126d73fb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-705bd5c1-fa6c-4f45-97db-436a849d1e04 tempest-VolumeDependencyTests-1616200110 None] Creating offline snapshot 6c71d3b8-425d-4fe0-85b7-27d29fc536e2 of volume ecfd1149-e4f6-466b-aadc-3e68159f95ec {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:11:41 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Volume volume-62610036-a372-474b-b84e-eb7c24e7f8c5 (62610036-a372-474b-b84e-eb7c24e7f8c5): created successfully Feb 27 02:11:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39abe4aa-0d9b-4686-ab0e-d8126d73fb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:41 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Flow 'volume_create_manager' (c3966213-5ede-4e2e-b430-7d550ee398a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:41 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6851b6-d87d-4f15-b538-e4b6e433a783]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-705bd5c1-fa6c-4f45-97db-436a849d1e04 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:41 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-9b2ec6c0-cc4c-4e12-9e2f-49a93a4dacb3 tempest-CreateVolumesFromImageTest-1178995007 None] Created volume successfully. Feb 27 02:11:41 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec Feb 27 02:11:41 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:41 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-705bd5c1-fa6c-4f45-97db-436a849d1e04 tempest-VolumeDependencyTests-1616200110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec" returned: 0 in 0.658s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-705bd5c1-fa6c-4f45-97db-436a849d1e04 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:41 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2 1G Feb 27 02:11:41 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:41 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5f3a46dc-e794-427c-b1d1-93b541beeef0 tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "cinder-62610036-a372-474b-b84e-eb7c24e7f8c5-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:41 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5f3a46dc-e794-427c-b1d1-93b541beeef0 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "cinder-62610036-a372-474b-b84e-eb7c24e7f8c5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:41 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5f3a46dc-e794-427c-b1d1-93b541beeef0 tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "cinder-quobyte-62610036-a372-474b-b84e-eb7c24e7f8c5" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:42 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5f3a46dc-e794-427c-b1d1-93b541beeef0 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "cinder-quobyte-62610036-a372-474b-b84e-eb7c24e7f8c5" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:42 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5d5885-0faf-47a4-8539-de71d5c12fc7]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f3a46dc-e794-427c-b1d1-93b541beeef0 tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62610036-a372-474b-b84e-eb7c24e7f8c5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:42 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62610036-a372-474b-b84e-eb7c24e7f8c5 Feb 27 02:11:42 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:42 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f3a46dc-e794-427c-b1d1-93b541beeef0 tempest-CreateVolumesFromImageTest-1178995007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62610036-a372-474b-b84e-eb7c24e7f8c5" returned: 0 in 0.599s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f3a46dc-e794-427c-b1d1-93b541beeef0 tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62610036-a372-474b-b84e-eb7c24e7f8c5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:42 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62610036-a372-474b-b84e-eb7c24e7f8c5 Feb 27 02:11:42 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:42 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-705bd5c1-fa6c-4f45-97db-436a849d1e04 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2 1G" returned: 0 in 0.827s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:42 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-705bd5c1-fa6c-4f45-97db-436a849d1e04 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:42 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2 Feb 27 02:11:42 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:43 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f3a46dc-e794-427c-b1d1-93b541beeef0 tempest-CreateVolumesFromImageTest-1178995007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62610036-a372-474b-b84e-eb7c24e7f8c5" returned: 0 in 0.523s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5f3a46dc-e794-427c-b1d1-93b541beeef0 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "cinder-quobyte-62610036-a372-474b-b84e-eb7c24e7f8c5" released by "delete_volume" :: held 1.165s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:43 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-5f3a46dc-e794-427c-b1d1-93b541beeef0 tempest-CreateVolumesFromImageTest-1178995007 None] Created reservations ['7a8327fd-a2da-4385-b50d-275f4cf3c89c', '51a94508-228a-44da-a3e8-0120a6c58687', '97568357-aef9-4d91-a241-8676d9339a6e', 'ebf3fb02-6012-4310-8f8c-05db712aabbc'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:43 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-705bd5c1-fa6c-4f45-97db-436a849d1e04 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2" returned: 0 in 0.595s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:43 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-705bd5c1-fa6c-4f45-97db-436a849d1e04 tempest-VolumeDependencyTests-1616200110 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2 is being set with open permissions: ugo+rw Feb 27 02:11:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-705bd5c1-fa6c-4f45-97db-436a849d1e04 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5f3a46dc-e794-427c-b1d1-93b541beeef0 tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5f3a46dc-e794-427c-b1d1-93b541beeef0 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5f3a46dc-e794-427c-b1d1-93b541beeef0 tempest-CreateVolumesFromImageTest-1178995007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:43 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5f3a46dc-e794-427c-b1d1-93b541beeef0 tempest-CreateVolumesFromImageTest-1178995007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5f3a46dc-e794-427c-b1d1-93b541beeef0 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f3a46dc-e794-427c-b1d1-93b541beeef0 tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:43 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2 Feb 27 02:11:43 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:43 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:11:43 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:43 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f3a46dc-e794-427c-b1d1-93b541beeef0 tempest-CreateVolumesFromImageTest-1178995007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.454s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:43 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-5f3a46dc-e794-427c-b1d1-93b541beeef0 tempest-CreateVolumesFromImageTest-1178995007 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:43 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-5f3a46dc-e794-427c-b1d1-93b541beeef0 tempest-CreateVolumesFromImageTest-1178995007 None] Deleted volume successfully. Feb 27 02:11:43 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-5f3a46dc-e794-427c-b1d1-93b541beeef0 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "cinder-62610036-a372-474b-b84e-eb7c24e7f8c5-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:43 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-705bd5c1-fa6c-4f45-97db-436a849d1e04 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2" returned: 0 in 0.525s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:43 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-705bd5c1-fa6c-4f45-97db-436a849d1e04 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:43 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.info Feb 27 02:11:43 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e265b9fe-a702-40fa-a67d-2aa0474c6253 tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "cinder-d77522f8-9ed0-4463-9869-d55209a426de-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e265b9fe-a702-40fa-a67d-2aa0474c6253 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "cinder-d77522f8-9ed0-4463-9869-d55209a426de-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e265b9fe-a702-40fa-a67d-2aa0474c6253 tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "cinder-quobyte-d77522f8-9ed0-4463-9869-d55209a426de" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e265b9fe-a702-40fa-a67d-2aa0474c6253 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "cinder-quobyte-d77522f8-9ed0-4463-9869-d55209a426de" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:44 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-705bd5c1-fa6c-4f45-97db-436a849d1e04 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.info" returned: 0 in 0.471s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:44 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-705bd5c1-fa6c-4f45-97db-436a849d1e04 tempest-VolumeDependencyTests-1616200110 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.info is being set with open permissions: ugo+rw Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-705bd5c1-fa6c-4f45-97db-436a849d1e04 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f80e708-7ab6-47f4-bab8-ac69b3c15d80]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e265b9fe-a702-40fa-a67d-2aa0474c6253 tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d77522f8-9ed0-4463-9869-d55209a426de {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:44 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.info Feb 27 02:11:44 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:44 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d77522f8-9ed0-4463-9869-d55209a426de Feb 27 02:11:44 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:44 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-705bd5c1-fa6c-4f45-97db-436a849d1e04 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.info" returned: 0 in 0.505s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-705bd5c1-fa6c-4f45-97db-436a849d1e04 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.685s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.628s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2130822625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536653d2-6fb6-4765-baf6-4aa4c523b08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100c945a09e94175879f9d1bbc90fbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:38Z,use_quota=True,user_id='aca9dcef8f6d4819b8b5f2c243c1dae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Creating volume 536653d2-6fb6-4765-baf6-4aa4c523b08c {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:44 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-536653d2-6fb6-4765-baf6-4aa4c523b08c 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:44 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-536653d2-6fb6-4765-baf6-4aa4c523b08c 1073741824 Feb 27 02:11:44 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:44 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-705bd5c1-fa6c-4f45-97db-436a849d1e04 tempest-VolumeDependencyTests-1616200110 None] Create snapshot completed successfully Feb 27 02:11:44 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e265b9fe-a702-40fa-a67d-2aa0474c6253 tempest-CreateVolumesFromImageTest-1178995007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d77522f8-9ed0-4463-9869-d55209a426de" returned: 0 in 0.603s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:44 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e265b9fe-a702-40fa-a67d-2aa0474c6253 tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d77522f8-9ed0-4463-9869-d55209a426de {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:44 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d77522f8-9ed0-4463-9869-d55209a426de Feb 27 02:11:44 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:45 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-536653d2-6fb6-4765-baf6-4aa4c523b08c 1073741824" returned: 0 in 0.738s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-536653d2-6fb6-4765-baf6-4aa4c523b08c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:45 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-536653d2-6fb6-4765-baf6-4aa4c523b08c Feb 27 02:11:45 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Flow 'volume_create_manager' (ec379320-6db9-4e62-b437-7efaf94d937a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b130999-bf3d-423a-b2c4-36a6205343e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b130999-bf3d-423a-b2c4-36a6205343e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2058769429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7a189c-6467-4291-baff-555af820fe31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e9fd887f1904a0ab14e58c1cbc19cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6c71d3b8-425d-4fe0-85b7-27d29fc536e2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:46Z,use_quota=True,user_id='915fc4ff56ad4380b75568109f562ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7bd64b-5314-4fa5-a8a7-5e3c45602bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7bd64b-5314-4fa5-a8a7-5e3c45602bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29be4c7d-32b7-44d2-b283-6dad25f2a67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:45 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29be4c7d-32b7-44d2-b283-6dad25f2a67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ae7a189c-6467-4291-baff-555af820fe31', 'volume_name': 'volume-ae7a189c-6467-4291-baff-555af820fe31', 'volume_size': 1, 'snapshot_id': '6c71d3b8-425d-4fe0-85b7-27d29fc536e2'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5960f4d9-bc6b-4a21-980b-e25e217e233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5960f4d9-bc6b-4a21-980b-e25e217e233e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fdab528-5aa2-4032-b5d2-0504296e7840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:45 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Volume ae7a189c-6467-4291-baff-555af820fe31: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ae7a189c-6467-4291-baff-555af820fe31', 'volume_size': 1, 'snapshot_id': '6c71d3b8-425d-4fe0-85b7-27d29fc536e2'} Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e265b9fe-a702-40fa-a67d-2aa0474c6253 tempest-CreateVolumesFromImageTest-1178995007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d77522f8-9ed0-4463-9869-d55209a426de" returned: 0 in 0.872s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e265b9fe-a702-40fa-a67d-2aa0474c6253 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "cinder-quobyte-d77522f8-9ed0-4463-9869-d55209a426de" released by "delete_volume" :: held 1.513s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-e265b9fe-a702-40fa-a67d-2aa0474c6253 tempest-CreateVolumesFromImageTest-1178995007 None] Created reservations ['ddc76573-ba2e-41b8-a730-f0cec86c61b1', '99fd6986-360e-456c-9f0e-10e962b35900', '30aa2259-d19e-4df7-aa7a-505a195c85ed', '4978f5b7-5463-431c-a02b-07825c0a04c7'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e265b9fe-a702-40fa-a67d-2aa0474c6253 tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e265b9fe-a702-40fa-a67d-2aa0474c6253 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e265b9fe-a702-40fa-a67d-2aa0474c6253 tempest-CreateVolumesFromImageTest-1178995007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e265b9fe-a702-40fa-a67d-2aa0474c6253 tempest-CreateVolumesFromImageTest-1178995007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e265b9fe-a702-40fa-a67d-2aa0474c6253 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:45 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e265b9fe-a702-40fa-a67d-2aa0474c6253 tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:45 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:11:45 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:46 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-536653d2-6fb6-4765-baf6-4aa4c523b08c" returned: 0 in 0.529s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.630s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-66799281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a3acff-2e23-41c6-a5c3-9973da525a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100c945a09e94175879f9d1bbc90fbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:38Z,use_quota=True,user_id='aca9dcef8f6d4819b8b5f2c243c1dae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Creating volume 65a3acff-2e23-41c6-a5c3-9973da525a6f {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:46 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-65a3acff-2e23-41c6-a5c3-9973da525a6f 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937c5359-fa38-4cf8-9fb0-66d9119dd0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-536653d2-6fb6-4765-baf6-4aa4c523b08c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9602bdc1-ece7-4cc2-bb7b-83dd7604d025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:46 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Volume volume-536653d2-6fb6-4765-baf6-4aa4c523b08c (536653d2-6fb6-4765-baf6-4aa4c523b08c): created successfully Feb 27 02:11:46 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-65a3acff-2e23-41c6-a5c3-9973da525a6f 1073741824 Feb 27 02:11:46 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9602bdc1-ece7-4cc2-bb7b-83dd7604d025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Flow 'volume_create_manager' (3ce0f62f-cb84-4769-9399-6120616323fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:46 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-bc636626-3ac2-4237-9f41-436f997a9701 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Created volume successfully. Feb 27 02:11:46 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e265b9fe-a702-40fa-a67d-2aa0474c6253 tempest-CreateVolumesFromImageTest-1178995007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.510s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-e265b9fe-a702-40fa-a67d-2aa0474c6253 tempest-CreateVolumesFromImageTest-1178995007 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:46 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e265b9fe-a702-40fa-a67d-2aa0474c6253 tempest-CreateVolumesFromImageTest-1178995007 None] Deleted volume successfully. Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-e265b9fe-a702-40fa-a67d-2aa0474c6253 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "cinder-d77522f8-9ed0-4463-9869-d55209a426de-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8c8c8c5d-b1a8-4da7-91e1-55e8db12f4f7 tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "cinder-1604c609-c7e6-4542-b019-bd6cdff798fe-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8c8c8c5d-b1a8-4da7-91e1-55e8db12f4f7 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "cinder-1604c609-c7e6-4542-b019-bd6cdff798fe-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8c8c8c5d-b1a8-4da7-91e1-55e8db12f4f7 tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "cinder-quobyte-1604c609-c7e6-4542-b019-bd6cdff798fe" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8c8c8c5d-b1a8-4da7-91e1-55e8db12f4f7 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "cinder-quobyte-1604c609-c7e6-4542-b019-bd6cdff798fe" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9f3ff8-40bb-4edf-8115-16dbc9aff21d]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c8c8c5d-b1a8-4da7-91e1-55e8db12f4f7 tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1604c609-c7e6-4542-b019-bd6cdff798fe {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:46 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1604c609-c7e6-4542-b019-bd6cdff798fe Feb 27 02:11:46 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:46 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-65a3acff-2e23-41c6-a5c3-9973da525a6f 1073741824" returned: 0 in 0.732s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:46 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-65a3acff-2e23-41c6-a5c3-9973da525a6f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:46 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-65a3acff-2e23-41c6-a5c3-9973da525a6f Feb 27 02:11:46 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:47 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c8c8c5d-b1a8-4da7-91e1-55e8db12f4f7 tempest-CreateVolumesFromImageTest-1178995007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1604c609-c7e6-4542-b019-bd6cdff798fe" returned: 0 in 0.635s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c8c8c5d-b1a8-4da7-91e1-55e8db12f4f7 tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1604c609-c7e6-4542-b019-bd6cdff798fe {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:47 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1604c609-c7e6-4542-b019-bd6cdff798fe Feb 27 02:11:47 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:47 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-65a3acff-2e23-41c6-a5c3-9973da525a6f" returned: 0 in 0.538s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.752s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-90503466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8853e25-daac-45b6-b65f-c23dacd7a310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100c945a09e94175879f9d1bbc90fbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:39Z,use_quota=True,user_id='aca9dcef8f6d4819b8b5f2c243c1dae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Creating volume f8853e25-daac-45b6-b65f-c23dacd7a310 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:47 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f8853e25-daac-45b6-b65f-c23dacd7a310 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:47 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f8853e25-daac-45b6-b65f-c23dacd7a310 1073741824 Feb 27 02:11:47 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b19c2c-aedd-40da-84df-e6ef9d4f2372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65a3acff-2e23-41c6-a5c3-9973da525a6f', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adffcd4-b669-4617-a596-eb8db258895f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:47 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Volume volume-65a3acff-2e23-41c6-a5c3-9973da525a6f (65a3acff-2e23-41c6-a5c3-9973da525a6f): created successfully Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adffcd4-b669-4617-a596-eb8db258895f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Flow 'volume_create_manager' (39152672-4ef8-40f8-bf9e-e71643abdcab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:47 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2d1a39ab-b96e-4fa2-96b3-f44a56c5c3db tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Created volume successfully. Feb 27 02:11:47 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c8c8c5d-b1a8-4da7-91e1-55e8db12f4f7 tempest-CreateVolumesFromImageTest-1178995007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1604c609-c7e6-4542-b019-bd6cdff798fe" returned: 0 in 0.582s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8c8c8c5d-b1a8-4da7-91e1-55e8db12f4f7 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "cinder-quobyte-1604c609-c7e6-4542-b019-bd6cdff798fe" released by "delete_volume" :: held 1.251s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-8c8c8c5d-b1a8-4da7-91e1-55e8db12f4f7 tempest-CreateVolumesFromImageTest-1178995007 None] Created reservations ['3ea4967b-e268-49e8-ae79-7d5de3342b27', 'edac5651-5751-44f4-b586-63151bc1d0aa', 'ba4862dc-5796-4614-8020-0ad86a8b147e', '40daa4ac-0f0f-4fd7-abdc-b069902e5d95'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c8c8c5d-b1a8-4da7-91e1-55e8db12f4f7 tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c8c8c5d-b1a8-4da7-91e1-55e8db12f4f7 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c8c8c5d-b1a8-4da7-91e1-55e8db12f4f7 tempest-CreateVolumesFromImageTest-1178995007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8c8c8c5d-b1a8-4da7-91e1-55e8db12f4f7 tempest-CreateVolumesFromImageTest-1178995007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8c8c8c5d-b1a8-4da7-91e1-55e8db12f4f7 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:47 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c8c8c5d-b1a8-4da7-91e1-55e8db12f4f7 tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:48 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:11:48 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:48 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f8853e25-daac-45b6-b65f-c23dacd7a310 1073741824" returned: 0 in 0.702s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f8853e25-daac-45b6-b65f-c23dacd7a310 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:48 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f8853e25-daac-45b6-b65f-c23dacd7a310 Feb 27 02:11:48 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:48 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8c8c8c5d-b1a8-4da7-91e1-55e8db12f4f7 tempest-CreateVolumesFromImageTest-1178995007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.626s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-8c8c8c5d-b1a8-4da7-91e1-55e8db12f4f7 tempest-CreateVolumesFromImageTest-1178995007 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:48 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8c8c8c5d-b1a8-4da7-91e1-55e8db12f4f7 tempest-CreateVolumesFromImageTest-1178995007 None] Deleted volume successfully. Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8c8c8c5d-b1a8-4da7-91e1-55e8db12f4f7 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "cinder-1604c609-c7e6-4542-b019-bd6cdff798fe-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c58d7d31-bf0c-4bc3-8396-1ec4746bbeb3 tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "cinder-a39dcbe5-166f-441f-a46e-c27cee39d274-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c58d7d31-bf0c-4bc3-8396-1ec4746bbeb3 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "cinder-a39dcbe5-166f-441f-a46e-c27cee39d274-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:48 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f8853e25-daac-45b6-b65f-c23dacd7a310" returned: 0 in 0.619s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.671s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-881071137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be7fd5e9-3bd5-4459-a441-58b5e5c2a04c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100c945a09e94175879f9d1bbc90fbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:39Z,use_quota=True,user_id='aca9dcef8f6d4819b8b5f2c243c1dae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Creating volume be7fd5e9-3bd5-4459-a441-58b5e5c2a04c {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:48 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c58d7d31-bf0c-4bc3-8396-1ec4746bbeb3 tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "cinder-quobyte-a39dcbe5-166f-441f-a46e-c27cee39d274" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401383aa-7c1b-4ae8-8d8a-f6a501323c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8853e25-daac-45b6-b65f-c23dacd7a310', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c81f0c-2e69-4873-91b1-15ed4b5b2859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:48 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c 1073741824 Feb 27 02:11:48 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c58d7d31-bf0c-4bc3-8396-1ec4746bbeb3 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "cinder-quobyte-a39dcbe5-166f-441f-a46e-c27cee39d274" acquired by "delete_volume" :: waited 0.049s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:48 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Volume volume-f8853e25-daac-45b6-b65f-c23dacd7a310 (f8853e25-daac-45b6-b65f-c23dacd7a310): created successfully Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c81f0c-2e69-4873-91b1-15ed4b5b2859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Flow 'volume_create_manager' (6125bda9-d637-44cc-92b9-a6eba6e98245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fdba32-235b-4205-8ed8-73d39c7268ec]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:48 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c58d7d31-bf0c-4bc3-8396-1ec4746bbeb3 tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a39dcbe5-166f-441f-a46e-c27cee39d274 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:48 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8308054f-36b8-41eb-bf36-e9158f44d58d tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Created volume successfully. Feb 27 02:11:49 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a39dcbe5-166f-441f-a46e-c27cee39d274 Feb 27 02:11:49 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:49 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c 1073741824" returned: 0 in 0.626s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:49 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c Feb 27 02:11:49 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:49 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c58d7d31-bf0c-4bc3-8396-1ec4746bbeb3 tempest-CreateVolumesFromImageTest-1178995007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a39dcbe5-166f-441f-a46e-c27cee39d274" returned: 0 in 0.675s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:49 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c58d7d31-bf0c-4bc3-8396-1ec4746bbeb3 tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a39dcbe5-166f-441f-a46e-c27cee39d274 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:49 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a39dcbe5-166f-441f-a46e-c27cee39d274 Feb 27 02:11:49 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:50 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c" returned: 0 in 0.602s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.862s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1550087012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2639baf2-4669-46a6-a828-2adb63d93d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='100c945a09e94175879f9d1bbc90fbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:39Z,use_quota=True,user_id='aca9dcef8f6d4819b8b5f2c243c1dae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Creating volume 2639baf2-4669-46a6-a828-2adb63d93d5a {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:50 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2639baf2-4669-46a6-a828-2adb63d93d5a 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:50 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d710362b-9839-4f3b-87ea-060678daeb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ea4c40-267d-4208-a46e-1f96a0bbe6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c58d7d31-bf0c-4bc3-8396-1ec4746bbeb3 tempest-CreateVolumesFromImageTest-1178995007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a39dcbe5-166f-441f-a46e-c27cee39d274" returned: 0 in 0.546s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:50 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2639baf2-4669-46a6-a828-2adb63d93d5a 1073741824 Feb 27 02:11:50 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:50 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Volume volume-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c (be7fd5e9-3bd5-4459-a441-58b5e5c2a04c): created successfully Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ea4c40-267d-4208-a46e-1f96a0bbe6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Flow 'volume_create_manager' (8cc3c65c-b8a2-4161-9f32-9569cdeef321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c58d7d31-bf0c-4bc3-8396-1ec4746bbeb3 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "cinder-quobyte-a39dcbe5-166f-441f-a46e-c27cee39d274" released by "delete_volume" :: held 1.270s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:50 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2b648e10-767c-4929-bcf3-bc18fba1da68 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Created volume successfully. Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-c58d7d31-bf0c-4bc3-8396-1ec4746bbeb3 tempest-CreateVolumesFromImageTest-1178995007 None] Created reservations ['bb0c8c13-b6a0-4659-a7be-1cbb7934dc86', 'bdf49775-7847-4b70-a0ac-cd5c505d1b5a', '505ac79f-bd85-476a-8e46-ad59093d7fcf', 'd74f1fc2-af9c-4d95-9409-6414c3674e0b'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c58d7d31-bf0c-4bc3-8396-1ec4746bbeb3 tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c58d7d31-bf0c-4bc3-8396-1ec4746bbeb3 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c58d7d31-bf0c-4bc3-8396-1ec4746bbeb3 tempest-CreateVolumesFromImageTest-1178995007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c58d7d31-bf0c-4bc3-8396-1ec4746bbeb3 tempest-CreateVolumesFromImageTest-1178995007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c58d7d31-bf0c-4bc3-8396-1ec4746bbeb3 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c58d7d31-bf0c-4bc3-8396-1ec4746bbeb3 tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:50 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:11:50 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:50 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2639baf2-4669-46a6-a828-2adb63d93d5a 1073741824" returned: 0 in 0.635s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2639baf2-4669-46a6-a828-2adb63d93d5a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:50 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2639baf2-4669-46a6-a828-2adb63d93d5a Feb 27 02:11:50 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:50 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c58d7d31-bf0c-4bc3-8396-1ec4746bbeb3 tempest-CreateVolumesFromImageTest-1178995007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.612s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-c58d7d31-bf0c-4bc3-8396-1ec4746bbeb3 tempest-CreateVolumesFromImageTest-1178995007 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:50 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c58d7d31-bf0c-4bc3-8396-1ec4746bbeb3 tempest-CreateVolumesFromImageTest-1178995007 None] Deleted volume successfully. Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c58d7d31-bf0c-4bc3-8396-1ec4746bbeb3 tempest-CreateVolumesFromImageTest-1178995007 None] Lock "cinder-a39dcbe5-166f-441f-a46e-c27cee39d274-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8150d8ce-b35a-4a94-9006-556fb1057bae tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "cinder-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:50 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8150d8ce-b35a-4a94-9006-556fb1057bae tempest-CreateVolumesFromImageTest-1178995007 None] Lock "cinder-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8150d8ce-b35a-4a94-9006-556fb1057bae tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "cinder-quobyte-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8150d8ce-b35a-4a94-9006-556fb1057bae tempest-CreateVolumesFromImageTest-1178995007 None] Lock "cinder-quobyte-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8606026c-baec-44af-896e-2910ad1704dd]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8150d8ce-b35a-4a94-9006-556fb1057bae tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:51 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c Feb 27 02:11:51 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:51 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2639baf2-4669-46a6-a828-2adb63d93d5a" returned: 0 in 0.512s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.522s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "cinder-quobyte-6c71d3b8-425d-4fe0-85b7-27d29fc536e2-ae7a189c-6467-4291-baff-555af820fe31" by "_create_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77da0db1-33f4-42e1-a241-09d533d980b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2639baf2-4669-46a6-a828-2adb63d93d5a', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb0a56c-c8c6-4248-81b4-a2e3abdc8ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Flow 'volume_create_manager' (e6a8c961-6b70-4c2f-81c1-cfdbb13b7483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f04b24-19d2-417a-a301-10a6a07a4aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-quobyte-6c71d3b8-425d-4fe0-85b7-27d29fc536e2-ae7a189c-6467-4291-baff-555af820fe31" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Creating volume ae7a189c-6467-4291-baff-555af820fe31 from snapshot 6c71d3b8-425d-4fe0-85b7-27d29fc536e2 {{(pid=83167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "cinder-quobyte-ae7a189c-6467-4291-baff-555af820fe31" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:51 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Volume volume-2639baf2-4669-46a6-a828-2adb63d93d5a (2639baf2-4669-46a6-a828-2adb63d93d5a): created successfully Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb0a56c-c8c6-4248-81b4-a2e3abdc8ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Flow 'volume_create_manager' (8b08473d-d972-4965-ae20-6b1d2d629fb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f04b24-19d2-417a-a301-10a6a07a4aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1657144496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc991f8f-2584-45af-965f-2dd68ca1b34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bcabd646516458f9c1c74640de7632e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:51Z,use_quota=True,user_id='7f257acca0a4463cbbeba66efc1a6698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34d03a3-dc40-4634-bc45-a4f78076532e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34d03a3-dc40-4634-bc45-a4f78076532e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a54b697-d211-48d6-b44a-6da2dcf8f2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a54b697-d211-48d6-b44a-6da2dcf8f2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc991f8f-2584-45af-965f-2dd68ca1b34c', 'volume_name': 'volume-bc991f8f-2584-45af-965f-2dd68ca1b34c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d134ad-fd96-49b3-90e9-7633eca783fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d134ad-fd96-49b3-90e9-7633eca783fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6610f79f-fd2e-46f7-918e-d3a3fcb6a394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:51 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Volume bc991f8f-2584-45af-965f-2dd68ca1b34c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc991f8f-2584-45af-965f-2dd68ca1b34c', 'volume_size': 1} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-quobyte-ae7a189c-6467-4291-baff-555af820fe31" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] snapshot: 6c71d3b8-425d-4fe0-85b7-27d29fc536e2, volume: ae7a189c-6467-4291-baff-555af820fe31, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:11:51 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-e6495169-8660-41fa-88fa-9f7155bc5ce2 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Created volume successfully. Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f6bd1d-070c-45fe-bc08-bec5e29a0eb7]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:51 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2 Feb 27 02:11:51 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:51 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8150d8ce-b35a-4a94-9006-556fb1057bae tempest-CreateVolumesFromImageTest-1178995007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c" returned: 0 in 0.558s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8150d8ce-b35a-4a94-9006-556fb1057bae tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:51 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c Feb 27 02:11:51 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:51 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2" returned: 0 in 0.512s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:11:51 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd15322-a1d4-44a2-a891-62cc4cb83e24]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:52 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8150d8ce-b35a-4a94-9006-556fb1057bae tempest-CreateVolumesFromImageTest-1178995007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c" returned: 0 in 0.413s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8150d8ce-b35a-4a94-9006-556fb1057bae tempest-CreateVolumesFromImageTest-1178995007 None] Lock "cinder-quobyte-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c" released by "delete_volume" :: held 0.994s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-8150d8ce-b35a-4a94-9006-556fb1057bae tempest-CreateVolumesFromImageTest-1178995007 None] Created reservations ['bcb85768-84c6-49e6-ad6a-f2d74b5e24d6', '1a028157-3812-4a13-b9c8-1ffc6f2a1db5', '905c339f-12e4-4805-8285-69beff640c24', '0a5379b0-8313-46a9-9b47-a06052345829'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:52 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec Feb 27 02:11:52 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8150d8ce-b35a-4a94-9006-556fb1057bae tempest-CreateVolumesFromImageTest-1178995007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8150d8ce-b35a-4a94-9006-556fb1057bae tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8150d8ce-b35a-4a94-9006-556fb1057bae tempest-CreateVolumesFromImageTest-1178995007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-8150d8ce-b35a-4a94-9006-556fb1057bae tempest-CreateVolumesFromImageTest-1178995007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8150d8ce-b35a-4a94-9006-556fb1057bae tempest-CreateVolumesFromImageTest-1178995007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8150d8ce-b35a-4a94-9006-556fb1057bae tempest-CreateVolumesFromImageTest-1178995007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:52 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:11:52 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1dd3642d-5d24-4945-ad3f-290efb77eee5 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "cinder-2639baf2-4669-46a6-a828-2adb63d93d5a-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1dd3642d-5d24-4945-ad3f-290efb77eee5 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-2639baf2-4669-46a6-a828-2adb63d93d5a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1dd3642d-5d24-4945-ad3f-290efb77eee5 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "cinder-quobyte-2639baf2-4669-46a6-a828-2adb63d93d5a" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1dd3642d-5d24-4945-ad3f-290efb77eee5 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-quobyte-2639baf2-4669-46a6-a828-2adb63d93d5a" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a28e395-daa5-453a-9b5f-e3290c6d6d99]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1dd3642d-5d24-4945-ad3f-290efb77eee5 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2639baf2-4669-46a6-a828-2adb63d93d5a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:52 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec" returned: 0 in 0.553s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Path /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ae7a189c-6467-4291-baff-555af820fe31 not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ae7a189c-6467-4291-baff-555af820fe31 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:52 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ae7a189c-6467-4291-baff-555af820fe31 Feb 27 02:11:52 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:52 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2639baf2-4669-46a6-a828-2adb63d93d5a Feb 27 02:11:52 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:52 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8150d8ce-b35a-4a94-9006-556fb1057bae tempest-CreateVolumesFromImageTest-1178995007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.502s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-8150d8ce-b35a-4a94-9006-556fb1057bae tempest-CreateVolumesFromImageTest-1178995007 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:52 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8150d8ce-b35a-4a94-9006-556fb1057bae tempest-CreateVolumesFromImageTest-1178995007 None] Deleted volume successfully. Feb 27 02:11:52 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-8150d8ce-b35a-4a94-9006-556fb1057bae tempest-CreateVolumesFromImageTest-1178995007 None] Lock "cinder-25cbc5bc-d41a-4290-ab1d-dc9ad730d72c-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:53 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1dd3642d-5d24-4945-ad3f-290efb77eee5 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2639baf2-4669-46a6-a828-2adb63d93d5a" returned: 0 in 0.543s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:53 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1dd3642d-5d24-4945-ad3f-290efb77eee5 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2639baf2-4669-46a6-a828-2adb63d93d5a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:53 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2639baf2-4669-46a6-a828-2adb63d93d5a Feb 27 02:11:53 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:54 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1dd3642d-5d24-4945-ad3f-290efb77eee5 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-2639baf2-4669-46a6-a828-2adb63d93d5a" returned: 0 in 1.263s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:54 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1dd3642d-5d24-4945-ad3f-290efb77eee5 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-quobyte-2639baf2-4669-46a6-a828-2adb63d93d5a" released by "delete_volume" :: held 1.839s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:54 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:UPDATE=181,cinder:SELECT=127,cinder:INSERT=31,cinder:DELETE=17 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:11:54 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-1dd3642d-5d24-4945-ad3f-290efb77eee5 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Created reservations ['644f49c0-43fa-4875-874c-a9b0b5e441eb', '3d18cab3-9664-421b-a1af-efc3be3e6ef1', '3bc93c4b-7cba-48ea-bc32-c6e7eb10dafd', '2165394c-ced2-4ac5-b87b-a97646a02eb6'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1dd3642d-5d24-4945-ad3f-290efb77eee5 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1dd3642d-5d24-4945-ad3f-290efb77eee5 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1dd3642d-5d24-4945-ad3f-290efb77eee5 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:54 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1dd3642d-5d24-4945-ad3f-290efb77eee5 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1dd3642d-5d24-4945-ad3f-290efb77eee5 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:54 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1dd3642d-5d24-4945-ad3f-290efb77eee5 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:54 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:11:54 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a2cc5a3d-c14d-4523-9e71-3b2eceed70de tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "cinder-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a2cc5a3d-c14d-4523-9e71-3b2eceed70de tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a2cc5a3d-c14d-4523-9e71-3b2eceed70de tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "cinder-quobyte-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a2cc5a3d-c14d-4523-9e71-3b2eceed70de tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-quobyte-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c" acquired by "delete_volume" :: waited 0.017s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d34147-810d-4a0e-9dd8-9491a012de3d]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a2cc5a3d-c14d-4523-9e71-3b2eceed70de tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:55 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ae7a189c-6467-4291-baff-555af820fe31" returned: 0 in 2.690s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f581a1cf-34c8-4349-834d-cc6745b6f69b]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:55 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c Feb 27 02:11:55 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:55 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec Feb 27 02:11:55 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:55 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1dd3642d-5d24-4945-ad3f-290efb77eee5 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.720s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-1dd3642d-5d24-4945-ad3f-290efb77eee5 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:55 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1dd3642d-5d24-4945-ad3f-290efb77eee5 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Deleted volume successfully. Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=112,cinder:INSERT=50,cinder:UPDATE=178,cinder:DELETE=17 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1dd3642d-5d24-4945-ad3f-290efb77eee5 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-2639baf2-4669-46a6-a828-2adb63d93d5a-delete_volume" released by "delete_volume" :: held 3.334s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Flow 'volume_create_manager' (35e7db6f-1872-4ce1-bc31-2861053bb739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b253190-dbad-4067-8400-e07c525ee50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:55 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b253190-dbad-4067-8400-e07c525ee50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-233017505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b36900-08fd-4b20-978a-1b2902b5f4dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c289087aa97142d1bea3d0952b9fd1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:56Z,use_quota=True,user_id='1b5c3865bd0b47f78f727563009c5fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d59774b0-2e8c-43b8-8ba6-ca819e98fdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d59774b0-2e8c-43b8-8ba6-ca819e98fdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60fe8a9-3514-441d-9740-0e7370d47a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60fe8a9-3514-441d-9740-0e7370d47a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5b36900-08fd-4b20-978a-1b2902b5f4dd', 'volume_name': 'volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da8c6af-e7c8-472a-8da2-02a2dae8f80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da8c6af-e7c8-472a-8da2-02a2dae8f80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b73894-3e72-4308-8102-0300988f9e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:55 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Volume a5b36900-08fd-4b20-978a-1b2902b5f4dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd', 'volume_size': 1} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a2cc5a3d-c14d-4523-9e71-3b2eceed70de tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c" returned: 0 in 0.638s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:55 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a2cc5a3d-c14d-4523-9e71-3b2eceed70de tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:55 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c Feb 27 02:11:55 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:56 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec" returned: 0 in 0.790s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Image conversion details: src /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec, size 1024.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ae7a189c-6467-4291-baff-555af820fe31 {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:11:56 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Converted 1024.00 MB image at 380.43 MB/s Feb 27 02:11:56 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ae7a189c-6467-4291-baff-555af820fe31 is being set with open permissions: ugo+rw Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ae7a189c-6467-4291-baff-555af820fe31 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:56 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ae7a189c-6467-4291-baff-555af820fe31 Feb 27 02:11:56 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:56 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a2cc5a3d-c14d-4523-9e71-3b2eceed70de tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c" returned: 0 in 0.498s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a2cc5a3d-c14d-4523-9e71-3b2eceed70de tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-quobyte-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c" released by "delete_volume" :: held 1.175s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-a2cc5a3d-c14d-4523-9e71-3b2eceed70de tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Created reservations ['5f9d4630-c963-43c7-b542-f074dd3c3f24', '75fc8749-346a-4de7-aa50-e99fa130f3c3', 'ff6e8843-9290-4bf1-822e-784c9a36906a', '656c2bcd-4e2c-4dec-9fb4-97489e9d64e2'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a2cc5a3d-c14d-4523-9e71-3b2eceed70de tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a2cc5a3d-c14d-4523-9e71-3b2eceed70de tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a2cc5a3d-c14d-4523-9e71-3b2eceed70de tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a2cc5a3d-c14d-4523-9e71-3b2eceed70de tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a2cc5a3d-c14d-4523-9e71-3b2eceed70de tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a2cc5a3d-c14d-4523-9e71-3b2eceed70de tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:56 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:11:56 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:56 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ae7a189c-6467-4291-baff-555af820fe31" returned: 0 in 0.593s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-quobyte-ae7a189c-6467-4291-baff-555af820fe31" released by "_copy_volume_from_snapshot" :: held 5.202s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-quobyte-6c71d3b8-425d-4fe0-85b7-27d29fc536e2-ae7a189c-6467-4291-baff-555af820fe31" released by "_create_volume_from_snapshot" :: held 5.266s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.319s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.229s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1657144496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc991f8f-2584-45af-965f-2dd68ca1b34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bcabd646516458f9c1c74640de7632e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:51Z,use_quota=True,user_id='7f257acca0a4463cbbeba66efc1a6698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Creating volume bc991f8f-2584-45af-965f-2dd68ca1b34c {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:56 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:56 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c 1073741824 Feb 27 02:11:56 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fdab528-5aa2-4032-b5d2-0504296e7840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae7a189c-6467-4291-baff-555af820fe31', 'volume_size': 1, 'snapshot_id': '6c71d3b8-425d-4fe0-85b7-27d29fc536e2'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d28f8b1-92e2-493a-8708-372d821e83d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:56 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Volume volume-ae7a189c-6467-4291-baff-555af820fe31 (ae7a189c-6467-4291-baff-555af820fe31): created successfully Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d28f8b1-92e2-493a-8708-372d821e83d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:56 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Flow 'volume_create_manager' (ec379320-6db9-4e62-b437-7efaf94d937a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:56 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b86508a7-e64a-4ed3-919f-5c5048e96380 tempest-VolumeDependencyTests-1616200110 None] Created volume successfully. Feb 27 02:11:57 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a2cc5a3d-c14d-4523-9e71-3b2eceed70de tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.650s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-a2cc5a3d-c14d-4523-9e71-3b2eceed70de tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:57 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a2cc5a3d-c14d-4523-9e71-3b2eceed70de tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Deleted volume successfully. Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a2cc5a3d-c14d-4523-9e71-3b2eceed70de tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-be7fd5e9-3bd5-4459-a441-58b5e5c2a04c-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-df91f6fb-c832-42e2-a517-804a2e08effb tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "cinder-f8853e25-daac-45b6-b65f-c23dacd7a310-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-df91f6fb-c832-42e2-a517-804a2e08effb tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-f8853e25-daac-45b6-b65f-c23dacd7a310-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:57 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c 1073741824" returned: 0 in 0.710s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-df91f6fb-c832-42e2-a517-804a2e08effb tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "cinder-quobyte-f8853e25-daac-45b6-b65f-c23dacd7a310" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-df91f6fb-c832-42e2-a517-804a2e08effb tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-quobyte-f8853e25-daac-45b6-b65f-c23dacd7a310" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75e016a-dfb1-456a-a744-720db7d1a46a]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df91f6fb-c832-42e2-a517-804a2e08effb tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f8853e25-daac-45b6-b65f-c23dacd7a310 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:57 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c Feb 27 02:11:57 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:57 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f8853e25-daac-45b6-b65f-c23dacd7a310 Feb 27 02:11:57 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "cinder-6c71d3b8-425d-4fe0-85b7-27d29fc536e2-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-6c71d3b8-425d-4fe0-85b7-27d29fc536e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "cinder-quobyte-ecfd1149-e4f6-466b-aadc-3e68159f95ec" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-quobyte-ecfd1149-e4f6-466b-aadc-3e68159f95ec" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "cinder-quobyte-6c71d3b8-425d-4fe0-85b7-27d29fc536e2" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-quobyte-6c71d3b8-425d-4fe0-85b7-27d29fc536e2" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] Deleting offline snapshot 6c71d3b8-425d-4fe0-85b7-27d29fc536e2 of volume ecfd1149-e4f6-466b-aadc-3e68159f95ec {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] snapshot_file for this snap is: volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f5cffa-37f4-4a7b-8c46-b50cf0f1479e]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:57 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:57 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2 Feb 27 02:11:57 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:57 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c" returned: 0 in 0.514s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.164s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-233017505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b36900-08fd-4b20-978a-1b2902b5f4dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c289087aa97142d1bea3d0952b9fd1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:56Z,use_quota=True,user_id='1b5c3865bd0b47f78f727563009c5fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Creating volume a5b36900-08fd-4b20-978a-1b2902b5f4dd {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:58 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6610f79f-fd2e-46f7-918e-d3a3fcb6a394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc991f8f-2584-45af-965f-2dd68ca1b34c', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:58 devstack sudo[90839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd 1073741824 Feb 27 02:11:58 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3dc9f1-473f-4c43-98e0-7702472c2d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:58 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Volume volume-bc991f8f-2584-45af-965f-2dd68ca1b34c (bc991f8f-2584-45af-965f-2dd68ca1b34c): created successfully Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3dc9f1-473f-4c43-98e0-7702472c2d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:58 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Flow 'volume_create_manager' (e6a8c961-6b70-4c2f-81c1-cfdbb13b7483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df91f6fb-c832-42e2-a517-804a2e08effb tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f8853e25-daac-45b6-b65f-c23dacd7a310" returned: 0 in 0.593s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df91f6fb-c832-42e2-a517-804a2e08effb tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f8853e25-daac-45b6-b65f-c23dacd7a310 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:58 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-5e60827b-0ae5-4eed-8131-08ba154be03e tempest-SnapshotDependencyTests-595956502 None] Created volume successfully. Feb 27 02:11:58 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f8853e25-daac-45b6-b65f-c23dacd7a310 Feb 27 02:11:58 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:58 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2" returned: 0 in 0.572s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2c7f33-4ac1-4da5-90ad-25db95e977ac]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:58 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec Feb 27 02:11:58 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:58 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd 1073741824" returned: 0 in 0.547s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:58 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df91f6fb-c832-42e2-a517-804a2e08effb tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-f8853e25-daac-45b6-b65f-c23dacd7a310" returned: 0 in 0.505s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-df91f6fb-c832-42e2-a517-804a2e08effb tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-quobyte-f8853e25-daac-45b6-b65f-c23dacd7a310" released by "delete_volume" :: held 1.127s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:58 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd Feb 27 02:11:58 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-df91f6fb-c832-42e2-a517-804a2e08effb tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Created reservations ['eaa06ffb-5539-4fa7-95ea-42c2b2e9b9cb', '869a3150-ffd5-4c9d-ac3b-f5c90d79b471', '6ef4419f-fd7b-48bf-9333-c4966c808a4b', 'd8b61893-f16f-4233-b4af-547925bdc99f'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-df91f6fb-c832-42e2-a517-804a2e08effb tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-df91f6fb-c832-42e2-a517-804a2e08effb tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-df91f6fb-c832-42e2-a517-804a2e08effb tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-df91f6fb-c832-42e2-a517-804a2e08effb tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-df91f6fb-c832-42e2-a517-804a2e08effb tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df91f6fb-c832-42e2-a517-804a2e08effb tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:58 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:11:58 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:58 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec" returned: 0 in 0.544s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:58 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:58 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2 Feb 27 02:11:58 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:59 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd" returned: 0 in 0.476s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b73894-3e72-4308-8102-0300988f9e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8820364-b09a-4b42-8b21-7d61f5b5f9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:59 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Volume volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd (a5b36900-08fd-4b20-978a-1b2902b5f4dd): created successfully Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8820364-b09a-4b42-8b21-7d61f5b5f9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Flow 'volume_create_manager' (35e7db6f-1872-4ce1-bc31-2861053bb739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:59 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-d37e217d-8e42-43b1-baf2-c821ee367433 tempest-CreateVolumesFromSnapshotTest-230118934 None] Created volume successfully. Feb 27 02:11:59 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-df91f6fb-c832-42e2-a517-804a2e08effb tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.479s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-df91f6fb-c832-42e2-a517-804a2e08effb tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:59 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-df91f6fb-c832-42e2-a517-804a2e08effb tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Deleted volume successfully. Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-df91f6fb-c832-42e2-a517-804a2e08effb tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-f8853e25-daac-45b6-b65f-c23dacd7a310-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-562db6b4-6741-494c-bfd5-449b1e1870bb tempest-SnapshotDependencyTests-595956502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-562db6b4-6741-494c-bfd5-449b1e1870bb tempest-SnapshotDependencyTests-595956502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-562db6b4-6741-494c-bfd5-449b1e1870bb tempest-SnapshotDependencyTests-595956502 None] Creating offline snapshot e523ea7d-8802-4043-b3e9-f51d5d834657 of volume bc991f8f-2584-45af-965f-2dd68ca1b34c {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b1d8ac-d07e-400d-9e4c-ee8660df4cb6]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-562db6b4-6741-494c-bfd5-449b1e1870bb tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:59 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2" returned: 0 in 0.546s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:59 devstack sudo[90867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2 Feb 27 02:11:59 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:59 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c Feb 27 02:11:59 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1a5b330f-457a-4542-b700-2fcda6d0708c tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "cinder-65a3acff-2e23-41c6-a5c3-9973da525a6f-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1a5b330f-457a-4542-b700-2fcda6d0708c tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-65a3acff-2e23-41c6-a5c3-9973da525a6f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1a5b330f-457a-4542-b700-2fcda6d0708c tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "cinder-quobyte-65a3acff-2e23-41c6-a5c3-9973da525a6f" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1a5b330f-457a-4542-b700-2fcda6d0708c tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-quobyte-65a3acff-2e23-41c6-a5c3-9973da525a6f" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc14852f-bd2e-459b-9c7f-5729c11cbea0]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1a5b330f-457a-4542-b700-2fcda6d0708c tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-65a3acff-2e23-41c6-a5c3-9973da525a6f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:59 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-65a3acff-2e23-41c6-a5c3-9973da525a6f Feb 27 02:11:59 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:59 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:59 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec.6c71d3b8-425d-4fe0-85b7-27d29fc536e2" returned: 0 in 0.485s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-562db6b4-6741-494c-bfd5-449b1e1870bb tempest-SnapshotDependencyTests-595956502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c" returned: 0 in 0.543s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-562db6b4-6741-494c-bfd5-449b1e1870bb tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:59 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657 1G Feb 27 02:11:59 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-quobyte-6c71d3b8-425d-4fe0-85b7-27d29fc536e2" released by "_delete_snapshot" :: held 2.217s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:59 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-quobyte-ecfd1149-e4f6-466b-aadc-3e68159f95ec" released by "delete_snapshot" :: held 2.231s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:00 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] Created reservations ['4d13b9be-145e-4753-8c4b-a1a3d629fee8', '4bdb73fb-0ee9-4f12-9fe3-ce428ae5180f', '24f63312-2037-4d46-99d0-91768d342baa', 'ab4632bc-abdf-4b4d-9063-9dbcf3f66aa7'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:00 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] Delete snapshot completed successfully. Feb 27 02:12:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ff05c0ca-ff1e-443d-bc99-d9e37b1f8ab2 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-6c71d3b8-425d-4fe0-85b7-27d29fc536e2-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8e40a6e4-f533-4e97-9729-2ae9bad75339 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:00 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1a5b330f-457a-4542-b700-2fcda6d0708c tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-65a3acff-2e23-41c6-a5c3-9973da525a6f" returned: 0 in 0.583s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1a5b330f-457a-4542-b700-2fcda6d0708c tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-65a3acff-2e23-41c6-a5c3-9973da525a6f {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:00 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-65a3acff-2e23-41c6-a5c3-9973da525a6f Feb 27 02:12:00 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:00 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-562db6b4-6741-494c-bfd5-449b1e1870bb tempest-SnapshotDependencyTests-595956502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657 1G" returned: 0 in 0.534s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-562db6b4-6741-494c-bfd5-449b1e1870bb tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc991f8f-2584-45af-965f-2dd68ca1b34c -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:00 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc991f8f-2584-45af-965f-2dd68ca1b34c -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657 Feb 27 02:12:00 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:00 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1a5b330f-457a-4542-b700-2fcda6d0708c tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-65a3acff-2e23-41c6-a5c3-9973da525a6f" returned: 0 in 0.502s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1a5b330f-457a-4542-b700-2fcda6d0708c tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-quobyte-65a3acff-2e23-41c6-a5c3-9973da525a6f" released by "delete_volume" :: held 1.113s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:00 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-1a5b330f-457a-4542-b700-2fcda6d0708c tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Created reservations ['1abc0ccf-1471-4129-94f0-5e1def105eca', 'e70bdf20-72a4-4f80-9703-ffc134665873', 'e80fcc08-f9bc-4eec-8186-b82f8949f58d', 'c59b06cb-d27d-415b-9c59-6c15d972d1b3'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1a5b330f-457a-4542-b700-2fcda6d0708c tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1a5b330f-457a-4542-b700-2fcda6d0708c tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:00 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1a5b330f-457a-4542-b700-2fcda6d0708c tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:00 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-1a5b330f-457a-4542-b700-2fcda6d0708c tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-1a5b330f-457a-4542-b700-2fcda6d0708c tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:00 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1a5b330f-457a-4542-b700-2fcda6d0708c tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:00 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:12:00 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:00 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f57943a8-6424-4eb3-a2a6-b14f9a638174 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "cinder-ecfd1149-e4f6-466b-aadc-3e68159f95ec-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f57943a8-6424-4eb3-a2a6-b14f9a638174 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-ecfd1149-e4f6-466b-aadc-3e68159f95ec-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:01 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-562db6b4-6741-494c-bfd5-449b1e1870bb tempest-SnapshotDependencyTests-595956502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc991f8f-2584-45af-965f-2dd68ca1b34c -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657" returned: 0 in 0.561s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:01 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-562db6b4-6741-494c-bfd5-449b1e1870bb tempest-SnapshotDependencyTests-595956502 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657 is being set with open permissions: ugo+rw Feb 27 02:12:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-562db6b4-6741-494c-bfd5-449b1e1870bb tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:01 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657 Feb 27 02:12:01 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f57943a8-6424-4eb3-a2a6-b14f9a638174 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "cinder-quobyte-ecfd1149-e4f6-466b-aadc-3e68159f95ec" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f57943a8-6424-4eb3-a2a6-b14f9a638174 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-quobyte-ecfd1149-e4f6-466b-aadc-3e68159f95ec" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:01 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf1bbea-c99d-4d9f-a588-e008d3aab294]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f57943a8-6424-4eb3-a2a6-b14f9a638174 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:01 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec Feb 27 02:12:01 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:01 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-1a5b330f-457a-4542-b700-2fcda6d0708c tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.627s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:01 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-1a5b330f-457a-4542-b700-2fcda6d0708c tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:01 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-1a5b330f-457a-4542-b700-2fcda6d0708c tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Deleted volume successfully. Feb 27 02:12:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-1a5b330f-457a-4542-b700-2fcda6d0708c tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-65a3acff-2e23-41c6-a5c3-9973da525a6f-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:01 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-562db6b4-6741-494c-bfd5-449b1e1870bb tempest-SnapshotDependencyTests-595956502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657" returned: 0 in 0.487s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-562db6b4-6741-494c-bfd5-449b1e1870bb tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:01 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.info Feb 27 02:12:01 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0ea2bb89-b53f-413a-82c1-eb0fbaa25430 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "cinder-536653d2-6fb6-4765-baf6-4aa4c523b08c-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:01 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0ea2bb89-b53f-413a-82c1-eb0fbaa25430 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-536653d2-6fb6-4765-baf6-4aa4c523b08c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f57943a8-6424-4eb3-a2a6-b14f9a638174 tempest-VolumeDependencyTests-1616200110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec" returned: 0 in 0.667s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f57943a8-6424-4eb3-a2a6-b14f9a638174 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:01 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec Feb 27 02:12:01 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0ea2bb89-b53f-413a-82c1-eb0fbaa25430 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "cinder-quobyte-536653d2-6fb6-4765-baf6-4aa4c523b08c" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:01 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0ea2bb89-b53f-413a-82c1-eb0fbaa25430 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-quobyte-536653d2-6fb6-4765-baf6-4aa4c523b08c" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:01 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b0d977-e2df-470b-a820-2406cc369286]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:01 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0ea2bb89-b53f-413a-82c1-eb0fbaa25430 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-536653d2-6fb6-4765-baf6-4aa4c523b08c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:01 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-536653d2-6fb6-4765-baf6-4aa4c523b08c Feb 27 02:12:01 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:02 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-562db6b4-6741-494c-bfd5-449b1e1870bb tempest-SnapshotDependencyTests-595956502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.info" returned: 0 in 0.550s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:02 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-562db6b4-6741-494c-bfd5-449b1e1870bb tempest-SnapshotDependencyTests-595956502 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.info is being set with open permissions: ugo+rw Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-562db6b4-6741-494c-bfd5-449b1e1870bb tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:02 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.info Feb 27 02:12:02 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:02 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f57943a8-6424-4eb3-a2a6-b14f9a638174 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ecfd1149-e4f6-466b-aadc-3e68159f95ec" returned: 0 in 0.505s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f57943a8-6424-4eb3-a2a6-b14f9a638174 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-quobyte-ecfd1149-e4f6-466b-aadc-3e68159f95ec" released by "delete_volume" :: held 1.208s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-f57943a8-6424-4eb3-a2a6-b14f9a638174 tempest-VolumeDependencyTests-1616200110 None] Created reservations ['0a11b951-41ed-49a3-8418-1ea2b4aeed9a', '2b651951-dfb3-4a2d-a604-6454ac1dd17d', 'a8410cd7-4345-4756-aa3c-71cb528c3a0e', '03dace59-7111-47f7-bc2d-e73618642869'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:02 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0ea2bb89-b53f-413a-82c1-eb0fbaa25430 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-536653d2-6fb6-4765-baf6-4aa4c523b08c" returned: 0 in 0.548s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0ea2bb89-b53f-413a-82c1-eb0fbaa25430 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-536653d2-6fb6-4765-baf6-4aa4c523b08c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f57943a8-6424-4eb3-a2a6-b14f9a638174 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f57943a8-6424-4eb3-a2a6-b14f9a638174 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f57943a8-6424-4eb3-a2a6-b14f9a638174 tempest-VolumeDependencyTests-1616200110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:02 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-536653d2-6fb6-4765-baf6-4aa4c523b08c Feb 27 02:12:02 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f57943a8-6424-4eb3-a2a6-b14f9a638174 tempest-VolumeDependencyTests-1616200110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f57943a8-6424-4eb3-a2a6-b14f9a638174 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f57943a8-6424-4eb3-a2a6-b14f9a638174 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:02 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:12:02 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:02 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-562db6b4-6741-494c-bfd5-449b1e1870bb tempest-SnapshotDependencyTests-595956502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.info" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-562db6b4-6741-494c-bfd5-449b1e1870bb tempest-SnapshotDependencyTests-595956502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.272s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8e40a6e4-f533-4e97-9729-2ae9bad75339 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.509s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-8e40a6e4-f533-4e97-9729-2ae9bad75339 tempest-CreateVolumesFromSnapshotTest-230118934 None] Creating offline snapshot d271f44a-5384-41bc-a233-cbe79f340a72 of volume a5b36900-08fd-4b20-978a-1b2902b5f4dd {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:12:02 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-562db6b4-6741-494c-bfd5-449b1e1870bb tempest-SnapshotDependencyTests-595956502 None] Create snapshot completed successfully Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca35bfe-12a7-4efd-b99d-67602d32a029]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8e40a6e4-f533-4e97-9729-2ae9bad75339 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:02 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd Feb 27 02:12:02 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:02 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0ea2bb89-b53f-413a-82c1-eb0fbaa25430 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-536653d2-6fb6-4765-baf6-4aa4c523b08c" returned: 0 in 0.458s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0ea2bb89-b53f-413a-82c1-eb0fbaa25430 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-quobyte-536653d2-6fb6-4765-baf6-4aa4c523b08c" released by "delete_volume" :: held 1.033s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-0ea2bb89-b53f-413a-82c1-eb0fbaa25430 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Created reservations ['56b8470a-434e-4fae-bf39-9e3940c2580e', '8e476dcb-f9ea-4892-99e9-2b6242df31d0', '300b3986-d42a-468c-9353-022b5c9866c9', '17619561-9612-44c0-9428-049442512ef8'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:02 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f57943a8-6424-4eb3-a2a6-b14f9a638174 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.514s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-f57943a8-6424-4eb3-a2a6-b14f9a638174 tempest-VolumeDependencyTests-1616200110 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:02 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f57943a8-6424-4eb3-a2a6-b14f9a638174 tempest-VolumeDependencyTests-1616200110 None] Deleted volume successfully. Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0ea2bb89-b53f-413a-82c1-eb0fbaa25430 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0ea2bb89-b53f-413a-82c1-eb0fbaa25430 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0ea2bb89-b53f-413a-82c1-eb0fbaa25430 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-0ea2bb89-b53f-413a-82c1-eb0fbaa25430 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-0ea2bb89-b53f-413a-82c1-eb0fbaa25430 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0ea2bb89-b53f-413a-82c1-eb0fbaa25430 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:02 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f57943a8-6424-4eb3-a2a6-b14f9a638174 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-ecfd1149-e4f6-466b-aadc-3e68159f95ec-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:03 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:12:03 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:03 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8e40a6e4-f533-4e97-9729-2ae9bad75339 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd" returned: 0 in 0.626s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8e40a6e4-f533-4e97-9729-2ae9bad75339 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.d271f44a-5384-41bc-a233-cbe79f340a72 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:03 devstack sudo[90931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.d271f44a-5384-41bc-a233-cbe79f340a72 1G Feb 27 02:12:03 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Flow 'volume_create_manager' (9a7f4a23-b61e-4164-9fa8-5a2be9d78cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f8cf06-7a03-474d-993e-3c082e1ab6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f8cf06-7a03-474d-993e-3c082e1ab6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1832307350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62bd1419-46ff-4c87-a107-8e4eaae57b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e9fd887f1904a0ab14e58c1cbc19cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:03Z,use_quota=True,user_id='915fc4ff56ad4380b75568109f562ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbab4bb2-08b0-400a-b3be-504cebdc1b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbab4bb2-08b0-400a-b3be-504cebdc1b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14bc89a-dce2-44ed-b6e4-cf1174d4d2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14bc89a-dce2-44ed-b6e4-cf1174d4d2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62bd1419-46ff-4c87-a107-8e4eaae57b74', 'volume_name': 'volume-62bd1419-46ff-4c87-a107-8e4eaae57b74', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dcc93e8-4d2f-48c8-a8eb-63e28b6124de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dcc93e8-4d2f-48c8-a8eb-63e28b6124de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c644b0-11cb-4941-adad-2f0984f0d946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:03 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Volume 62bd1419-46ff-4c87-a107-8e4eaae57b74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62bd1419-46ff-4c87-a107-8e4eaae57b74', 'volume_size': 1} Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:03 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-0ea2bb89-b53f-413a-82c1-eb0fbaa25430 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.548s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-0ea2bb89-b53f-413a-82c1-eb0fbaa25430 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:03 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-0ea2bb89-b53f-413a-82c1-eb0fbaa25430 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Deleted volume successfully. Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-0ea2bb89-b53f-413a-82c1-eb0fbaa25430 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-536653d2-6fb6-4765-baf6-4aa4c523b08c-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:03 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8e40a6e4-f533-4e97-9729-2ae9bad75339 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.d271f44a-5384-41bc-a233-cbe79f340a72 1G" returned: 0 in 0.599s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8e40a6e4-f533-4e97-9729-2ae9bad75339 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.d271f44a-5384-41bc-a233-cbe79f340a72 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:03 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.d271f44a-5384-41bc-a233-cbe79f340a72 Feb 27 02:12:03 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-235648fb-16f0-4359-934a-7174ceb97795 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "cinder-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Flow 'volume_create_manager' (d596968b-773e-4476-9339-d9dc5146eea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:03 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906b8dc6-0229-4a9a-b449-224aafc6099a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906b8dc6-0229-4a9a-b449-224aafc6099a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25dc9aff-d49e-4f16-b735-2b0b27ad542c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bcabd646516458f9c1c74640de7632e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e523ea7d-8802-4043-b3e9-f51d5d834657,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:04Z,use_quota=True,user_id='7f257acca0a4463cbbeba66efc1a6698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83590855-07dd-4b79-8716-37b294b78c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83590855-07dd-4b79-8716-37b294b78c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424c1c55-8948-42ca-925c-ffd34e97ebbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (424c1c55-8948-42ca-925c-ffd34e97ebbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '25dc9aff-d49e-4f16-b735-2b0b27ad542c', 'volume_name': 'volume-25dc9aff-d49e-4f16-b735-2b0b27ad542c', 'volume_size': 1, 'snapshot_id': 'e523ea7d-8802-4043-b3e9-f51d5d834657'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12cab862-e684-4810-b6fb-99d3b6f7bc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12cab862-e684-4810-b6fb-99d3b6f7bc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:04 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e8ae00-e3f0-4cb6-9e6d-b86d3ec49293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:04 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Volume 25dc9aff-d49e-4f16-b735-2b0b27ad542c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-25dc9aff-d49e-4f16-b735-2b0b27ad542c', 'volume_size': 1, 'snapshot_id': 'e523ea7d-8802-4043-b3e9-f51d5d834657'} Feb 27 02:12:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-235648fb-16f0-4359-934a-7174ceb97795 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-235648fb-16f0-4359-934a-7174ceb97795 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "cinder-quobyte-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:04 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-235648fb-16f0-4359-934a-7174ceb97795 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-quobyte-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:04 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1a598d-bed3-40a4-9656-ed709323644c]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-235648fb-16f0-4359-934a-7174ceb97795 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:04 devstack sudo[90939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c Feb 27 02:12:04 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:04 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8e40a6e4-f533-4e97-9729-2ae9bad75339 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.d271f44a-5384-41bc-a233-cbe79f340a72" returned: 0 in 0.487s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:04 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-8e40a6e4-f533-4e97-9729-2ae9bad75339 tempest-CreateVolumesFromSnapshotTest-230118934 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.d271f44a-5384-41bc-a233-cbe79f340a72 is being set with open permissions: ugo+rw Feb 27 02:12:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8e40a6e4-f533-4e97-9729-2ae9bad75339 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.d271f44a-5384-41bc-a233-cbe79f340a72 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:04 devstack sudo[90944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.d271f44a-5384-41bc-a233-cbe79f340a72 Feb 27 02:12:04 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:04 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-235648fb-16f0-4359-934a-7174ceb97795 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c" returned: 0 in 0.514s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-235648fb-16f0-4359-934a-7174ceb97795 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:04 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c Feb 27 02:12:04 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:04 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8e40a6e4-f533-4e97-9729-2ae9bad75339 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.d271f44a-5384-41bc-a233-cbe79f340a72" returned: 0 in 0.402s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:04 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8e40a6e4-f533-4e97-9729-2ae9bad75339 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:04 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.info Feb 27 02:12:04 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:05 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-235648fb-16f0-4359-934a-7174ceb97795 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c" returned: 0 in 0.482s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-235648fb-16f0-4359-934a-7174ceb97795 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-quobyte-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c" released by "delete_volume" :: held 1.019s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-235648fb-16f0-4359-934a-7174ceb97795 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Created reservations ['c111221b-8758-4a2f-9287-c7d2a2ca9690', 'e3445345-6fae-4f05-8945-a821af321427', '64aa1295-4bb1-4135-8aee-b7c4b9f3f1f7', 'cd54eed2-99da-4b3e-a7fd-bad76fcd48a1'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-235648fb-16f0-4359-934a-7174ceb97795 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-235648fb-16f0-4359-934a-7174ceb97795 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-235648fb-16f0-4359-934a-7174ceb97795 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-235648fb-16f0-4359-934a-7174ceb97795 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-235648fb-16f0-4359-934a-7174ceb97795 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-235648fb-16f0-4359-934a-7174ceb97795 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:05 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:12:05 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:05 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8e40a6e4-f533-4e97-9729-2ae9bad75339 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.info" returned: 0 in 0.443s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:05 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-8e40a6e4-f533-4e97-9729-2ae9bad75339 tempest-CreateVolumesFromSnapshotTest-230118934 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.info is being set with open permissions: ugo+rw Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8e40a6e4-f533-4e97-9729-2ae9bad75339 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:05 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.info Feb 27 02:12:05 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:05 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-235648fb-16f0-4359-934a-7174ceb97795 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.427s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-235648fb-16f0-4359-934a-7174ceb97795 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:05 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-235648fb-16f0-4359-934a-7174ceb97795 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Deleted volume successfully. Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-235648fb-16f0-4359-934a-7174ceb97795 tempest-CreateVolumesFromSourceVolumeTest-822713029 None] Lock "cinder-1ceb1f8b-6475-41ed-8b42-c8eced43fc5c-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:05 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-8e40a6e4-f533-4e97-9729-2ae9bad75339 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.info" returned: 0 in 0.437s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-8e40a6e4-f533-4e97-9729-2ae9bad75339 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.077s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.248s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1832307350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62bd1419-46ff-4c87-a107-8e4eaae57b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e9fd887f1904a0ab14e58c1cbc19cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:03Z,use_quota=True,user_id='915fc4ff56ad4380b75568109f562ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Creating volume 62bd1419-46ff-4c87-a107-8e4eaae57b74 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:05 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:12:05 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:05 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 1073741824 Feb 27 02:12:05 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:05 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-8e40a6e4-f533-4e97-9729-2ae9bad75339 tempest-CreateVolumesFromSnapshotTest-230118934 None] Create snapshot completed successfully Feb 27 02:12:06 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 1073741824" returned: 0 in 0.496s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:06 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 Feb 27 02:12:06 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Flow 'volume_create_manager' (fa1c4ba1-12b1-4fa2-8501-9f1a3aa67802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64a7b56-6cf9-4dbc-9877-24a965f85664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64a7b56-6cf9-4dbc-9877-24a965f85664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1486082988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e251407-b175-4e5e-a943-25470b3dc3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c289087aa97142d1bea3d0952b9fd1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:07Z,use_quota=True,user_id='1b5c3865bd0b47f78f727563009c5fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2823ce-099a-4156-8bbd-8211b0117a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2823ce-099a-4156-8bbd-8211b0117a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a015fbb0-2400-48bb-bcc0-993e426db2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a015fbb0-2400-48bb-bcc0-993e426db2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e251407-b175-4e5e-a943-25470b3dc3b4', 'volume_name': 'volume-0e251407-b175-4e5e-a943-25470b3dc3b4', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77dd121-e1ac-4ad9-9046-a4de6df43957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77dd121-e1ac-4ad9-9046-a4de6df43957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2300c08e-e8e8-4f8d-bcb1-413432db713c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:06 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Volume 0e251407-b175-4e5e-a943-25470b3dc3b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e251407-b175-4e5e-a943-25470b3dc3b4', 'volume_size': 1} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:06 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74" returned: 0 in 0.605s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.835s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Acquiring lock "cinder-quobyte-e523ea7d-8802-4043-b3e9-f51d5d834657-25dc9aff-d49e-4f16-b735-2b0b27ad542c" by "_create_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c644b0-11cb-4941-adad-2f0984f0d946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62bd1419-46ff-4c87-a107-8e4eaae57b74', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a300986a-b698-4833-ae01-90cec6fea37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:06 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Volume volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 (62bd1419-46ff-4c87-a107-8e4eaae57b74): created successfully Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a300986a-b698-4833-ae01-90cec6fea37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Flow 'volume_create_manager' (9a7f4a23-b61e-4164-9fa8-5a2be9d78cd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Lock "cinder-quobyte-e523ea7d-8802-4043-b3e9-f51d5d834657-25dc9aff-d49e-4f16-b735-2b0b27ad542c" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Creating volume 25dc9aff-d49e-4f16-b735-2b0b27ad542c from snapshot e523ea7d-8802-4043-b3e9-f51d5d834657 {{(pid=83167) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Acquiring lock "cinder-quobyte-25dc9aff-d49e-4f16-b735-2b0b27ad542c" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Lock "cinder-quobyte-25dc9aff-d49e-4f16-b735-2b0b27ad542c" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] snapshot: e523ea7d-8802-4043-b3e9-f51d5d834657, volume: 25dc9aff-d49e-4f16-b735-2b0b27ad542c, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:06 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:07 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a54850cb-5f7d-43f3-98fe-78a7fe111db5 tempest-VolumeDependencyTests-1616200110 None] Created volume successfully. Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5442381d-8c17-47bc-a2df-49447ee543f9]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Flow 'volume_create_manager' (a74a9ec2-f06d-410b-ad98-a3d40efbf337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3a363d-d0d6-4af5-a1f8-1e3b2524fdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3a363d-d0d6-4af5-a1f8-1e3b2524fdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1534840815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ce74df-dc5a-438c-843f-72ea23e44c74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c289087aa97142d1bea3d0952b9fd1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:07Z,use_quota=True,user_id='1b5c3865bd0b47f78f727563009c5fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8018613b-7c35-46c1-bb30-786c27a99375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8018613b-7c35-46c1-bb30-786c27a99375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1aca65-41c8-4581-ba1f-28050cd08331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1aca65-41c8-4581-ba1f-28050cd08331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7ce74df-dc5a-438c-843f-72ea23e44c74', 'volume_name': 'volume-d7ce74df-dc5a-438c-843f-72ea23e44c74', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30f9f20-8ff5-43ea-93f7-ee832650cc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30f9f20-8ff5-43ea-93f7-ee832650cc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657 Feb 27 02:12:07 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05538939-d262-45da-97dd-60c22e95a46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Volume d7ce74df-dc5a-438c-843f-72ea23e44c74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7ce74df-dc5a-438c-843f-72ea23e44c74', 'volume_size': 1} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Flow 'volume_create_manager' (87686270-76b2-45df-a4fa-79650153d5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687a7cd7-27ad-4161-84c2-4c88dc615962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687a7cd7-27ad-4161-84c2-4c88dc615962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1977085949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bcd090d-dffe-49eb-a690-497fcfd82bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c289087aa97142d1bea3d0952b9fd1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:07Z,use_quota=True,user_id='1b5c3865bd0b47f78f727563009c5fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fad7c46-d250-4d05-a7ba-5dce55c5d93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fad7c46-d250-4d05-a7ba-5dce55c5d93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ebe2f6-6e39-41f7-85e9-598e4a7b03b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ebe2f6-6e39-41f7-85e9-598e4a7b03b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bcd090d-dffe-49eb-a690-497fcfd82bb5', 'volume_name': 'volume-0bcd090d-dffe-49eb-a690-497fcfd82bb5', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9513e379-d0b9-41ff-b716-d36b1dccf70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9513e379-d0b9-41ff-b716-d36b1dccf70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed771c14-1daf-4b64-be5f-f0629e9713c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Volume 0bcd090d-dffe-49eb-a690-497fcfd82bb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bcd090d-dffe-49eb-a690-497fcfd82bb5', 'volume_size': 1} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Flow 'volume_create_manager' (6234d15c-4277-4bfc-9a13-625f1fde9e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558ef438-1bb3-4dfc-ab45-d70fa5a0cc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558ef438-1bb3-4dfc-ab45-d70fa5a0cc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1175900739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8859889a-c78c-4439-9a19-e5b60eae2140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c289087aa97142d1bea3d0952b9fd1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:07Z,use_quota=True,user_id='1b5c3865bd0b47f78f727563009c5fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d769542-a90c-4120-90b8-cef3d834e697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d769542-a90c-4120-90b8-cef3d834e697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e497543a-18e6-42c1-ae2d-a11cdcc9828a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e497543a-18e6-42c1-ae2d-a11cdcc9828a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8859889a-c78c-4439-9a19-e5b60eae2140', 'volume_name': 'volume-8859889a-c78c-4439-9a19-e5b60eae2140', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14fa7d18-80bb-4cbf-8468-9cd8e3c4f5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14fa7d18-80bb-4cbf-8468-9cd8e3c4f5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8d782a-6974-41e9-9488-089f6dc0f8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Volume 8859889a-c78c-4439-9a19-e5b60eae2140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8859889a-c78c-4439-9a19-e5b60eae2140', 'volume_size': 1} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Flow 'volume_create_manager' (e604f3df-da83-40c1-8ef7-327ea171f764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d515dd5a-e930-4b7e-945e-7085dd707180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d515dd5a-e930-4b7e-945e-7085dd707180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2123583946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869d0ec7-5f46-4a87-8f63-6db61df71e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c289087aa97142d1bea3d0952b9fd1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:08Z,use_quota=True,user_id='1b5c3865bd0b47f78f727563009c5fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db01bf35-c273-46f2-8b99-fe6a8b4e4649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db01bf35-c273-46f2-8b99-fe6a8b4e4649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55cf92e-1225-4eab-aa2f-65755bb90fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55cf92e-1225-4eab-aa2f-65755bb90fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '869d0ec7-5f46-4a87-8f63-6db61df71e88', 'volume_name': 'volume-869d0ec7-5f46-4a87-8f63-6db61df71e88', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fd2648-13da-49d2-899a-966b2db164e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fd2648-13da-49d2-899a-966b2db164e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a5bfcea-4cdf-402a-828b-b3816a1fee9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:07 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Volume 869d0ec7-5f46-4a87-8f63-6db61df71e88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-869d0ec7-5f46-4a87-8f63-6db61df71e88', 'volume_size': 1} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657" returned: 0 in 0.801s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc991f8f-2584-45af-965f-2dd68ca1b34c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f980d43-f09b-4120-9065-5f070a473a75]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:07 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:07 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c Feb 27 02:12:07 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Flow 'volume_create_manager' (4b72a93c-e580-4b97-9301-243764aab20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ffe0bf-d32f-49e0-b013-e850651eb25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ffe0bf-d32f-49e0-b013-e850651eb25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1713211727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a3626a-d276-4894-bcb5-2c4fe304d1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e9fd887f1904a0ab14e58c1cbc19cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=62bd1419-46ff-4c87-a107-8e4eaae57b74,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:08Z,use_quota=True,user_id='915fc4ff56ad4380b75568109f562ddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aedccd27-bb43-4d0c-9670-f2b4b0c35336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aedccd27-bb43-4d0c-9670-f2b4b0c35336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3fb4fd-e541-486d-b296-13ea3472b604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3fb4fd-e541-486d-b296-13ea3472b604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '38a3626a-d276-4894-bcb5-2c4fe304d1cf', 'volume_name': 'volume-38a3626a-d276-4894-bcb5-2c4fe304d1cf', 'volume_size': 1, 'source_volid': '62bd1419-46ff-4c87-a107-8e4eaae57b74', 'source_volstatus': 'available'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ab1513-cafb-4bdb-907d-99dffdc7f3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ab1513-cafb-4bdb-907d-99dffdc7f3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43524b8c-8f8c-4180-aef8-3defe46d6622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Volume 38a3626a-d276-4894-bcb5-2c4fe304d1cf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-38a3626a-d276-4894-bcb5-2c4fe304d1cf', 'volume_size': 1, 'source_volid': '62bd1419-46ff-4c87-a107-8e4eaae57b74', 'source_volstatus': 'available'} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:08 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Path /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25dc9aff-d49e-4f16-b735-2b0b27ad542c not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25dc9aff-d49e-4f16-b735-2b0b27ad542c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:08 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25dc9aff-d49e-4f16-b735-2b0b27ad542c Feb 27 02:12:08 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Flow 'volume_create_manager' (a3612c18-e1a1-455f-bbd0-40a4e10d5d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f133a5-17c7-4c37-94dc-b21baf2fc482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f133a5-17c7-4c37-94dc-b21baf2fc482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea022ec8-fafb-4d4e-8d98-981db3bbcbde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b7e0bfa88344e6ba33ef4f5badfa60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:08Z,use_quota=True,user_id='b287164e6e244f858e27c852d516ab8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ddc5c2c-e789-48fb-b9b0-2b7c5cc1c2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ddc5c2c-e789-48fb-b9b0-2b7c5cc1c2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d1ab34-9427-464d-8e26-392bfd24dc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d1ab34-9427-464d-8e26-392bfd24dc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea022ec8-fafb-4d4e-8d98-981db3bbcbde', 'volume_name': 'volume-ea022ec8-fafb-4d4e-8d98-981db3bbcbde', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19a2d7c-72b1-42d4-935e-3d4a7a8d99fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19a2d7c-72b1-42d4-935e-3d4a7a8d99fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca955e6-4328-42b8-8256-5995ff606ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:08 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Volume ea022ec8-fafb-4d4e-8d98-981db3bbcbde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea022ec8-fafb-4d4e-8d98-981db3bbcbde', 'volume_size': 1} Feb 27 02:12:08 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:10 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25dc9aff-d49e-4f16-b735-2b0b27ad542c" returned: 0 in 2.461s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:10 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d22e87-52eb-42b3-a08b-13587c0c1abd]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:10 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:10 devstack sudo[90993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c Feb 27 02:12:10 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:11 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c" returned: 0 in 0.652s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:11 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Image conversion details: src /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c, size 1024.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25dc9aff-d49e-4f16-b735-2b0b27ad542c {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:12:11 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Converted 1024.00 MB image at 415.91 MB/s Feb 27 02:12:11 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25dc9aff-d49e-4f16-b735-2b0b27ad542c is being set with open permissions: ugo+rw Feb 27 02:12:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25dc9aff-d49e-4f16-b735-2b0b27ad542c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:11 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25dc9aff-d49e-4f16-b735-2b0b27ad542c Feb 27 02:12:11 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:11 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25dc9aff-d49e-4f16-b735-2b0b27ad542c" returned: 0 in 0.479s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Lock "cinder-quobyte-25dc9aff-d49e-4f16-b735-2b0b27ad542c" released by "_copy_volume_from_snapshot" :: held 5.003s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:11 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Lock "cinder-quobyte-e523ea7d-8802-4043-b3e9-f51d5d834657-25dc9aff-d49e-4f16-b735-2b0b27ad542c" released by "_create_volume_from_snapshot" :: held 5.060s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.099s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.199s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1486082988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e251407-b175-4e5e-a943-25470b3dc3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c289087aa97142d1bea3d0952b9fd1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:07Z,use_quota=True,user_id='1b5c3865bd0b47f78f727563009c5fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Creating volume 0e251407-b175-4e5e-a943-25470b3dc3b4 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:11 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:11 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:12:11 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e251407-b175-4e5e-a943-25470b3dc3b4 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:12 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e251407-b175-4e5e-a943-25470b3dc3b4 1073741824 Feb 27 02:12:12 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e8ae00-e3f0-4cb6-9e6d-b86d3ec49293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25dc9aff-d49e-4f16-b735-2b0b27ad542c', 'volume_size': 1, 'snapshot_id': 'e523ea7d-8802-4043-b3e9-f51d5d834657'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af855a36-bdaf-4037-b481-2cb93b621b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:12 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Volume volume-25dc9aff-d49e-4f16-b735-2b0b27ad542c (25dc9aff-d49e-4f16-b735-2b0b27ad542c): created successfully Feb 27 02:12:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af855a36-bdaf-4037-b481-2cb93b621b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:12 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Flow 'volume_create_manager' (d596968b-773e-4476-9339-d9dc5146eea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:12 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a3cd0b32-0892-4eb5-a4ba-954b243cbe84 tempest-SnapshotDependencyTests-595956502 None] Created volume successfully. Feb 27 02:12:12 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e251407-b175-4e5e-a943-25470b3dc3b4 1073741824" returned: 0 in 0.567s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] Acquiring lock "cinder-e523ea7d-8802-4043-b3e9-f51d5d834657-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e251407-b175-4e5e-a943-25470b3dc3b4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] Lock "cinder-e523ea7d-8802-4043-b3e9-f51d5d834657-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] Acquiring lock "cinder-quobyte-bc991f8f-2584-45af-965f-2dd68ca1b34c" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:12 devstack sudo[91006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e251407-b175-4e5e-a943-25470b3dc3b4 Feb 27 02:12:12 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] Lock "cinder-quobyte-bc991f8f-2584-45af-965f-2dd68ca1b34c" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] Acquiring lock "cinder-quobyte-e523ea7d-8802-4043-b3e9-f51d5d834657" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:12 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] Lock "cinder-quobyte-e523ea7d-8802-4043-b3e9-f51d5d834657" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] Deleting offline snapshot e523ea7d-8802-4043-b3e9-f51d5d834657 of volume bc991f8f-2584-45af-965f-2dd68ca1b34c {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:12:12 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] snapshot_file for this snap is: volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:12:12 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb87bcd0-2997-41ae-ab8e-015f312a5521]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:12 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:12 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657 Feb 27 02:12:12 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:13 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e251407-b175-4e5e-a943-25470b3dc3b4" returned: 0 in 0.470s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.937s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1534840815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ce74df-dc5a-438c-843f-72ea23e44c74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c289087aa97142d1bea3d0952b9fd1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:07Z,use_quota=True,user_id='1b5c3865bd0b47f78f727563009c5fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Creating volume d7ce74df-dc5a-438c-843f-72ea23e44c74 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:13 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d7ce74df-dc5a-438c-843f-72ea23e44c74 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2300c08e-e8e8-4f8d-bcb1-413432db713c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e251407-b175-4e5e-a943-25470b3dc3b4', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8e9e04-2bc5-4251-aa8d-26b7d1facf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:13 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d7ce74df-dc5a-438c-843f-72ea23e44c74 1073741824 Feb 27 02:12:13 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:13 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Volume volume-0e251407-b175-4e5e-a943-25470b3dc3b4 (0e251407-b175-4e5e-a943-25470b3dc3b4): created successfully Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8e9e04-2bc5-4251-aa8d-26b7d1facf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Flow 'volume_create_manager' (fa1c4ba1-12b1-4fa2-8501-9f1a3aa67802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:13 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-60b3517a-96dd-4d96-968c-ce861e254c40 tempest-CreateVolumesFromSnapshotTest-230118934 None] Created volume successfully. Feb 27 02:12:13 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657" returned: 0 in 0.494s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc991f8f-2584-45af-965f-2dd68ca1b34c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f779fe5-ce79-41cd-92de-ae84396227cf]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:13 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c Feb 27 02:12:13 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:13 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d7ce74df-dc5a-438c-843f-72ea23e44c74 1073741824" returned: 0 in 0.527s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d7ce74df-dc5a-438c-843f-72ea23e44c74 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:13 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d7ce74df-dc5a-438c-843f-72ea23e44c74 Feb 27 02:12:13 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:13 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c" returned: 0 in 0.550s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:13 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:13 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657 Feb 27 02:12:13 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:14 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d7ce74df-dc5a-438c-843f-72ea23e44c74" returned: 0 in 0.415s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.744s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1977085949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bcd090d-dffe-49eb-a690-497fcfd82bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c289087aa97142d1bea3d0952b9fd1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:07Z,use_quota=True,user_id='1b5c3865bd0b47f78f727563009c5fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Creating volume 0bcd090d-dffe-49eb-a690-497fcfd82bb5 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:14 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0bcd090d-dffe-49eb-a690-497fcfd82bb5 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05538939-d262-45da-97dd-60c22e95a46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7ce74df-dc5a-438c-843f-72ea23e44c74', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:14 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0bcd090d-dffe-49eb-a690-497fcfd82bb5 1073741824 Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d10fba-0149-40b7-aedb-8fcb5f703d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:14 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:14 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Volume volume-d7ce74df-dc5a-438c-843f-72ea23e44c74 (d7ce74df-dc5a-438c-843f-72ea23e44c74): created successfully Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18d10fba-0149-40b7-aedb-8fcb5f703d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Flow 'volume_create_manager' (a74a9ec2-f06d-410b-ad98-a3d40efbf337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:14 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7bfdf459-4140-4c1a-a9ef-2cc1d4f51767 tempest-CreateVolumesFromSnapshotTest-230118934 None] Created volume successfully. Feb 27 02:12:14 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657" returned: 0 in 0.561s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:14 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657 Feb 27 02:12:14 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:14 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0bcd090d-dffe-49eb-a690-497fcfd82bb5 1073741824" returned: 0 in 0.591s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0bcd090d-dffe-49eb-a690-497fcfd82bb5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:14 devstack sudo[91040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0bcd090d-dffe-49eb-a690-497fcfd82bb5 Feb 27 02:12:14 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:14 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c.e523ea7d-8802-4043-b3e9-f51d5d834657" returned: 0 in 0.477s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] Lock "cinder-quobyte-e523ea7d-8802-4043-b3e9-f51d5d834657" released by "_delete_snapshot" :: held 2.138s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] Lock "cinder-quobyte-bc991f8f-2584-45af-965f-2dd68ca1b34c" released by "delete_snapshot" :: held 2.153s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] Created reservations ['0bd567cb-7ed2-4fcf-8c1f-060f9f420df9', '536b6528-eea9-46d3-a992-aa5b0347b5bd', '7dac7bd5-5fdb-4dd8-9cd1-fc26cb471a78', '69d74dd2-fd8b-45a4-98ce-27997bcdc3dc'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:14 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] Delete snapshot completed successfully. Feb 27 02:12:14 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-7a3db107-1e2b-44e3-a316-32daf9bc935e tempest-SnapshotDependencyTests-595956502 None] Lock "cinder-e523ea7d-8802-4043-b3e9-f51d5d834657-delete_snapshot" released by "delete_snapshot" :: held 2.238s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:15 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0bcd090d-dffe-49eb-a690-497fcfd82bb5" returned: 0 in 0.445s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.630s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1175900739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8859889a-c78c-4439-9a19-e5b60eae2140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c289087aa97142d1bea3d0952b9fd1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:07Z,use_quota=True,user_id='1b5c3865bd0b47f78f727563009c5fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Creating volume 8859889a-c78c-4439-9a19-e5b60eae2140 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:15 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8859889a-c78c-4439-9a19-e5b60eae2140 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed771c14-1daf-4b64-be5f-f0629e9713c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bcd090d-dffe-49eb-a690-497fcfd82bb5', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1fd9f9-1f8b-420f-b191-e56d2119c2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:15 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8859889a-c78c-4439-9a19-e5b60eae2140 1073741824 Feb 27 02:12:15 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:15 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Volume volume-0bcd090d-dffe-49eb-a690-497fcfd82bb5 (0bcd090d-dffe-49eb-a690-497fcfd82bb5): created successfully Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1fd9f9-1f8b-420f-b191-e56d2119c2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Flow 'volume_create_manager' (87686270-76b2-45df-a4fa-79650153d5e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:15 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-2c4d9711-4db9-4bf5-98fb-438efc7bf91f tempest-CreateVolumesFromSnapshotTest-230118934 None] Created volume successfully. Feb 27 02:12:15 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8859889a-c78c-4439-9a19-e5b60eae2140 1073741824" returned: 0 in 0.520s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8859889a-c78c-4439-9a19-e5b60eae2140 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:15 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8859889a-c78c-4439-9a19-e5b60eae2140 Feb 27 02:12:15 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f6c6886a-87c3-4729-beee-34f0526d4335 tempest-SnapshotDependencyTests-595956502 None] Acquiring lock "cinder-bc991f8f-2584-45af-965f-2dd68ca1b34c-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f6c6886a-87c3-4729-beee-34f0526d4335 tempest-SnapshotDependencyTests-595956502 None] Lock "cinder-bc991f8f-2584-45af-965f-2dd68ca1b34c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f6c6886a-87c3-4729-beee-34f0526d4335 tempest-SnapshotDependencyTests-595956502 None] Acquiring lock "cinder-quobyte-bc991f8f-2584-45af-965f-2dd68ca1b34c" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f6c6886a-87c3-4729-beee-34f0526d4335 tempest-SnapshotDependencyTests-595956502 None] Lock "cinder-quobyte-bc991f8f-2584-45af-965f-2dd68ca1b34c" acquired by "delete_volume" :: waited 0.019s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[9909a72a-8e4e-4dca-a495-8cd279ca03ea]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:15 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6c6886a-87c3-4729-beee-34f0526d4335 tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:15 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c Feb 27 02:12:15 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:16 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8859889a-c78c-4439-9a19-e5b60eae2140" returned: 0 in 0.521s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.414s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2123583946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869d0ec7-5f46-4a87-8f63-6db61df71e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c289087aa97142d1bea3d0952b9fd1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:08Z,use_quota=True,user_id='1b5c3865bd0b47f78f727563009c5fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Creating volume 869d0ec7-5f46-4a87-8f63-6db61df71e88 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:16 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-869d0ec7-5f46-4a87-8f63-6db61df71e88 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8d782a-6974-41e9-9488-089f6dc0f8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8859889a-c78c-4439-9a19-e5b60eae2140', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fec7fd8-54af-4f21-9f16-0df66dfe74e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:16 devstack sudo[91056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-869d0ec7-5f46-4a87-8f63-6db61df71e88 1073741824 Feb 27 02:12:16 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:16 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Volume volume-8859889a-c78c-4439-9a19-e5b60eae2140 (8859889a-c78c-4439-9a19-e5b60eae2140): created successfully Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fec7fd8-54af-4f21-9f16-0df66dfe74e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Flow 'volume_create_manager' (6234d15c-4277-4bfc-9a13-625f1fde9e77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:16 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c7713088-aab4-4f1f-91dc-374c602e3ef8 tempest-CreateVolumesFromSnapshotTest-230118934 None] Created volume successfully. Feb 27 02:12:16 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6c6886a-87c3-4729-beee-34f0526d4335 tempest-SnapshotDependencyTests-595956502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c" returned: 0 in 0.513s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6c6886a-87c3-4729-beee-34f0526d4335 tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:16 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c Feb 27 02:12:16 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:16 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6c6886a-87c3-4729-beee-34f0526d4335 tempest-SnapshotDependencyTests-595956502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-bc991f8f-2584-45af-965f-2dd68ca1b34c" returned: 0 in 0.495s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:16 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-869d0ec7-5f46-4a87-8f63-6db61df71e88 1073741824" returned: 0 in 0.625s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f6c6886a-87c3-4729-beee-34f0526d4335 tempest-SnapshotDependencyTests-595956502 None] Lock "cinder-quobyte-bc991f8f-2584-45af-965f-2dd68ca1b34c" released by "delete_volume" :: held 1.051s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-869d0ec7-5f46-4a87-8f63-6db61df71e88 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:16 devstack sudo[91067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-869d0ec7-5f46-4a87-8f63-6db61df71e88 Feb 27 02:12:16 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-f6c6886a-87c3-4729-beee-34f0526d4335 tempest-SnapshotDependencyTests-595956502 None] Created reservations ['33639184-5fef-4aab-8805-690334dbf185', 'ddcdc6f5-f404-43a0-b891-11d7fa097e3f', '0bd7738c-2007-4125-a386-34a55a37b2d0', '2ad5641c-3fa4-4545-8a01-3a1efa349836'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6c6886a-87c3-4729-beee-34f0526d4335 tempest-SnapshotDependencyTests-595956502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6c6886a-87c3-4729-beee-34f0526d4335 tempest-SnapshotDependencyTests-595956502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f6c6886a-87c3-4729-beee-34f0526d4335 tempest-SnapshotDependencyTests-595956502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f6c6886a-87c3-4729-beee-34f0526d4335 tempest-SnapshotDependencyTests-595956502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f6c6886a-87c3-4729-beee-34f0526d4335 tempest-SnapshotDependencyTests-595956502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:16 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6c6886a-87c3-4729-beee-34f0526d4335 tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:17 devstack sudo[91069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:12:17 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:17 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-869d0ec7-5f46-4a87-8f63-6db61df71e88" returned: 0 in 0.468s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.164s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:17 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Cloning volume 62bd1419-46ff-4c87-a107-8e4eaae57b74 to volume 38a3626a-d276-4894-bcb5-2c4fe304d1cf Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a5bfcea-4cdf-402a-828b-b3816a1fee9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-869d0ec7-5f46-4a87-8f63-6db61df71e88', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5341a699-465e-4cfb-b698-6c1824b7f812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:17 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Volume volume-869d0ec7-5f46-4a87-8f63-6db61df71e88 (869d0ec7-5f46-4a87-8f63-6db61df71e88): created successfully Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5341a699-465e-4cfb-b698-6c1824b7f812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Flow 'volume_create_manager' (e604f3df-da83-40c1-8ef7-327ea171f764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:17 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f6c6886a-87c3-4729-beee-34f0526d4335 tempest-SnapshotDependencyTests-595956502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.432s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-f6c6886a-87c3-4729-beee-34f0526d4335 tempest-SnapshotDependencyTests-595956502 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:17 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-50674e07-4d2e-4f65-a303-5ce0994c3a5d tempest-CreateVolumesFromSnapshotTest-230118934 None] Created volume successfully. Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Creating offline snapshot 365cc6b5-a681-4d77-bd76-8a5721b4f62a of volume 62bd1419-46ff-4c87-a107-8e4eaae57b74 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:12:17 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f6c6886a-87c3-4729-beee-34f0526d4335 tempest-SnapshotDependencyTests-595956502 None] Deleted volume successfully. Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f6c6886a-87c3-4729-beee-34f0526d4335 tempest-SnapshotDependencyTests-595956502 None] Lock "cinder-bc991f8f-2584-45af-965f-2dd68ca1b34c-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f947e9-e992-4835-a84e-d898ad8a244e]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c512c2f1-762e-45bd-ad86-2ccf75b277d1 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "cinder-869d0ec7-5f46-4a87-8f63-6db61df71e88-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c512c2f1-762e-45bd-ad86-2ccf75b277d1 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-869d0ec7-5f46-4a87-8f63-6db61df71e88-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:17 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 Feb 27 02:12:17 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c512c2f1-762e-45bd-ad86-2ccf75b277d1 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "cinder-quobyte-869d0ec7-5f46-4a87-8f63-6db61df71e88" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c512c2f1-762e-45bd-ad86-2ccf75b277d1 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-quobyte-869d0ec7-5f46-4a87-8f63-6db61df71e88" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b114ca0-570b-42a0-a3f3-01a7f9cb068b]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c512c2f1-762e-45bd-ad86-2ccf75b277d1 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-869d0ec7-5f46-4a87-8f63-6db61df71e88 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:17 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-869d0ec7-5f46-4a87-8f63-6db61df71e88 Feb 27 02:12:17 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4106f817-c3a5-44f7-820a-0be23858c672 tempest-SnapshotDependencyTests-595956502 None] Acquiring lock "cinder-25dc9aff-d49e-4f16-b735-2b0b27ad542c-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:17 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4106f817-c3a5-44f7-820a-0be23858c672 tempest-SnapshotDependencyTests-595956502 None] Lock "cinder-25dc9aff-d49e-4f16-b735-2b0b27ad542c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4106f817-c3a5-44f7-820a-0be23858c672 tempest-SnapshotDependencyTests-595956502 None] Acquiring lock "cinder-quobyte-25dc9aff-d49e-4f16-b735-2b0b27ad542c" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4106f817-c3a5-44f7-820a-0be23858c672 tempest-SnapshotDependencyTests-595956502 None] Lock "cinder-quobyte-25dc9aff-d49e-4f16-b735-2b0b27ad542c" acquired by "delete_volume" :: waited 0.025s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:18 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74" returned: 0 in 0.608s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[2890fdc6-f2f1-408b-9ff4-053c9e5d61fa]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4106f817-c3a5-44f7-820a-0be23858c672 tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25dc9aff-d49e-4f16-b735-2b0b27ad542c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:18 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a 1G Feb 27 02:12:18 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:18 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c512c2f1-762e-45bd-ad86-2ccf75b277d1 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-869d0ec7-5f46-4a87-8f63-6db61df71e88" returned: 0 in 0.553s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c512c2f1-762e-45bd-ad86-2ccf75b277d1 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-869d0ec7-5f46-4a87-8f63-6db61df71e88 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:18 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25dc9aff-d49e-4f16-b735-2b0b27ad542c Feb 27 02:12:18 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:18 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-869d0ec7-5f46-4a87-8f63-6db61df71e88 Feb 27 02:12:18 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:18 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c512c2f1-762e-45bd-ad86-2ccf75b277d1 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-869d0ec7-5f46-4a87-8f63-6db61df71e88" returned: 0 in 0.449s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:18 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4106f817-c3a5-44f7-820a-0be23858c672 tempest-SnapshotDependencyTests-595956502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25dc9aff-d49e-4f16-b735-2b0b27ad542c" returned: 0 in 0.546s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4106f817-c3a5-44f7-820a-0be23858c672 tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25dc9aff-d49e-4f16-b735-2b0b27ad542c {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c512c2f1-762e-45bd-ad86-2ccf75b277d1 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-quobyte-869d0ec7-5f46-4a87-8f63-6db61df71e88" released by "delete_volume" :: held 1.047s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:18 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25dc9aff-d49e-4f16-b735-2b0b27ad542c Feb 27 02:12:18 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-c512c2f1-762e-45bd-ad86-2ccf75b277d1 tempest-CreateVolumesFromSnapshotTest-230118934 None] Created reservations ['f61d02fa-edc3-4816-b4fa-e6f0851629e5', 'e5cebee5-d25e-4495-aee8-ae16bd7da8da', '6ceabb7b-9626-41d1-9dbd-1ad7995b14c7', '59d25969-63d4-437c-8cd4-deadb7ed0ad1'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:18 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a 1G" returned: 0 in 0.653s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c512c2f1-762e-45bd-ad86-2ccf75b277d1 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c512c2f1-762e-45bd-ad86-2ccf75b277d1 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c512c2f1-762e-45bd-ad86-2ccf75b277d1 tempest-CreateVolumesFromSnapshotTest-230118934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-c512c2f1-762e-45bd-ad86-2ccf75b277d1 tempest-CreateVolumesFromSnapshotTest-230118934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-c512c2f1-762e-45bd-ad86-2ccf75b277d1 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:18 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c512c2f1-762e-45bd-ad86-2ccf75b277d1 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:18 devstack sudo[91099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a Feb 27 02:12:18 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:18 devstack sudo[91100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:12:18 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:19 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4106f817-c3a5-44f7-820a-0be23858c672 tempest-SnapshotDependencyTests-595956502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-25dc9aff-d49e-4f16-b735-2b0b27ad542c" returned: 0 in 0.512s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4106f817-c3a5-44f7-820a-0be23858c672 tempest-SnapshotDependencyTests-595956502 None] Lock "cinder-quobyte-25dc9aff-d49e-4f16-b735-2b0b27ad542c" released by "delete_volume" :: held 1.104s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-4106f817-c3a5-44f7-820a-0be23858c672 tempest-SnapshotDependencyTests-595956502 None] Created reservations ['27a3961d-9809-4ca8-abf4-56c198de0bbe', '615df1a1-1ca7-4941-9e88-dd5c94bdea06', '18391840-3835-4622-ad74-bc780c3d5660', 'f31e495b-3763-4fc0-929c-3976b8462f73'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:19 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-c512c2f1-762e-45bd-ad86-2ccf75b277d1 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.471s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-c512c2f1-762e-45bd-ad86-2ccf75b277d1 tempest-CreateVolumesFromSnapshotTest-230118934 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:19 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-c512c2f1-762e-45bd-ad86-2ccf75b277d1 tempest-CreateVolumesFromSnapshotTest-230118934 None] Deleted volume successfully. Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-c512c2f1-762e-45bd-ad86-2ccf75b277d1 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-869d0ec7-5f46-4a87-8f63-6db61df71e88-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4106f817-c3a5-44f7-820a-0be23858c672 tempest-SnapshotDependencyTests-595956502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4106f817-c3a5-44f7-820a-0be23858c672 tempest-SnapshotDependencyTests-595956502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4106f817-c3a5-44f7-820a-0be23858c672 tempest-SnapshotDependencyTests-595956502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:19 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-4106f817-c3a5-44f7-820a-0be23858c672 tempest-SnapshotDependencyTests-595956502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-4106f817-c3a5-44f7-820a-0be23858c672 tempest-SnapshotDependencyTests-595956502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4106f817-c3a5-44f7-820a-0be23858c672 tempest-SnapshotDependencyTests-595956502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a" returned: 0 in 0.536s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:19 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a is being set with open permissions: ugo+rw Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:19 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:12:19 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:19 devstack sudo[91109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a Feb 27 02:12:19 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:19 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a" returned: 0 in 0.407s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:19 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-4106f817-c3a5-44f7-820a-0be23858c672 tempest-SnapshotDependencyTests-595956502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.430s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-4106f817-c3a5-44f7-820a-0be23858c672 tempest-SnapshotDependencyTests-595956502 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:19 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-4106f817-c3a5-44f7-820a-0be23858c672 tempest-SnapshotDependencyTests-595956502 None] Deleted volume successfully. Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:19 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.info Feb 27 02:12:19 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-4106f817-c3a5-44f7-820a-0be23858c672 tempest-SnapshotDependencyTests-595956502 None] Lock "cinder-25dc9aff-d49e-4f16-b735-2b0b27ad542c-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f4ca6fe3-d8ce-4ff9-9f67-5bd375c6665b tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "cinder-8859889a-c78c-4439-9a19-e5b60eae2140-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f4ca6fe3-d8ce-4ff9-9f67-5bd375c6665b tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-8859889a-c78c-4439-9a19-e5b60eae2140-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f4ca6fe3-d8ce-4ff9-9f67-5bd375c6665b tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "cinder-quobyte-8859889a-c78c-4439-9a19-e5b60eae2140" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f4ca6fe3-d8ce-4ff9-9f67-5bd375c6665b tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-quobyte-8859889a-c78c-4439-9a19-e5b60eae2140" acquired by "delete_volume" :: waited 0.006s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[113f5d30-67f4-42d6-a26d-35f34f01c1af]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:19 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f4ca6fe3-d8ce-4ff9-9f67-5bd375c6665b tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8859889a-c78c-4439-9a19-e5b60eae2140 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:19 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8859889a-c78c-4439-9a19-e5b60eae2140 Feb 27 02:12:19 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:20 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.info" returned: 0 in 0.427s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:20 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.info is being set with open permissions: ugo+rw Feb 27 02:12:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:20 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.info Feb 27 02:12:20 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:20 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f4ca6fe3-d8ce-4ff9-9f67-5bd375c6665b tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8859889a-c78c-4439-9a19-e5b60eae2140" returned: 0 in 0.539s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f4ca6fe3-d8ce-4ff9-9f67-5bd375c6665b tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8859889a-c78c-4439-9a19-e5b60eae2140 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:20 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8859889a-c78c-4439-9a19-e5b60eae2140 Feb 27 02:12:20 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:20 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.info" returned: 0 in 0.467s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "cinder-quobyte-38a3626a-d276-4894-bcb5-2c4fe304d1cf" by "_copy_volume_from_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-quobyte-38a3626a-d276-4894-bcb5-2c4fe304d1cf" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] snapshot: 365cc6b5-a681-4d77-bd76-8a5721b4f62a, volume: 38a3626a-d276-4894-bcb5-2c4fe304d1cf, {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:12:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:20 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:20 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac048f5f-9467-48b1-9268-9623558db6be]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:20 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a Feb 27 02:12:20 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:20 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:20 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f4ca6fe3-d8ce-4ff9-9f67-5bd375c6665b tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-8859889a-c78c-4439-9a19-e5b60eae2140" returned: 0 in 0.559s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:20 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f4ca6fe3-d8ce-4ff9-9f67-5bd375c6665b tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-quobyte-8859889a-c78c-4439-9a19-e5b60eae2140" released by "delete_volume" :: held 1.141s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:20 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-f4ca6fe3-d8ce-4ff9-9f67-5bd375c6665b tempest-CreateVolumesFromSnapshotTest-230118934 None] Created reservations ['cfad9726-6d52-4b1d-bc61-4b645ad1e514', '8e15ff98-b42e-4d09-a9f1-c0cdbf09041d', '3ec97761-42e2-4adb-9abc-a2ff5e27ddb1', '0cbd5b04-1802-47b9-8e89-f7ce0e153675'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f4ca6fe3-d8ce-4ff9-9f67-5bd375c6665b tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f4ca6fe3-d8ce-4ff9-9f67-5bd375c6665b tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f4ca6fe3-d8ce-4ff9-9f67-5bd375c6665b tempest-CreateVolumesFromSnapshotTest-230118934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-f4ca6fe3-d8ce-4ff9-9f67-5bd375c6665b tempest-CreateVolumesFromSnapshotTest-230118934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-f4ca6fe3-d8ce-4ff9-9f67-5bd375c6665b tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f4ca6fe3-d8ce-4ff9-9f67-5bd375c6665b tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:21 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:12:21 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:21 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a" returned: 0 in 0.678s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62bd1419-46ff-4c87-a107-8e4eaae57b74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:12:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:12:21 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Creating direct copy from snapshot {{(pid=83167) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:12:21 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[976d443a-00d1-48bf-98f3-314886465540]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:21 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 Feb 27 02:12:21 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:21 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:21 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-f4ca6fe3-d8ce-4ff9-9f67-5bd375c6665b tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.619s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:21 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-f4ca6fe3-d8ce-4ff9-9f67-5bd375c6665b tempest-CreateVolumesFromSnapshotTest-230118934 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:21 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-f4ca6fe3-d8ce-4ff9-9f67-5bd375c6665b tempest-CreateVolumesFromSnapshotTest-230118934 None] Deleted volume successfully. Feb 27 02:12:21 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-f4ca6fe3-d8ce-4ff9-9f67-5bd375c6665b tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-8859889a-c78c-4439-9a19-e5b60eae2140-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:21 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74" returned: 0 in 0.669s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:22 devstack cinder-volume[83167]: DEBUG cinder.utils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Path /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-38a3626a-d276-4894-bcb5-2c4fe304d1cf not found in is_blk_device check {{(pid=83167) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:12:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-38a3626a-d276-4894-bcb5-2c4fe304d1cf {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b21432a3-1e73-4dd8-a711-f8b25b120a12 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "cinder-0bcd090d-dffe-49eb-a690-497fcfd82bb5-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:22 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-38a3626a-d276-4894-bcb5-2c4fe304d1cf Feb 27 02:12:22 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b21432a3-1e73-4dd8-a711-f8b25b120a12 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-0bcd090d-dffe-49eb-a690-497fcfd82bb5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b21432a3-1e73-4dd8-a711-f8b25b120a12 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "cinder-quobyte-0bcd090d-dffe-49eb-a690-497fcfd82bb5" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:22 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b21432a3-1e73-4dd8-a711-f8b25b120a12 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-quobyte-0bcd090d-dffe-49eb-a690-497fcfd82bb5" acquired by "delete_volume" :: waited 0.011s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:22 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a6a022-c229-4bcd-867b-57ba48b71f10]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:22 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b21432a3-1e73-4dd8-a711-f8b25b120a12 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0bcd090d-dffe-49eb-a690-497fcfd82bb5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:22 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0bcd090d-dffe-49eb-a690-497fcfd82bb5 Feb 27 02:12:22 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:23 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b21432a3-1e73-4dd8-a711-f8b25b120a12 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0bcd090d-dffe-49eb-a690-497fcfd82bb5" returned: 0 in 1.103s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:23 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b21432a3-1e73-4dd8-a711-f8b25b120a12 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0bcd090d-dffe-49eb-a690-497fcfd82bb5 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:23 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0bcd090d-dffe-49eb-a690-497fcfd82bb5 Feb 27 02:12:23 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:24 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b21432a3-1e73-4dd8-a711-f8b25b120a12 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0bcd090d-dffe-49eb-a690-497fcfd82bb5" returned: 0 in 1.227s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:24 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b21432a3-1e73-4dd8-a711-f8b25b120a12 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-quobyte-0bcd090d-dffe-49eb-a690-497fcfd82bb5" released by "delete_volume" :: held 2.366s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:24 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-b21432a3-1e73-4dd8-a711-f8b25b120a12 tempest-CreateVolumesFromSnapshotTest-230118934 None] Created reservations ['ace187f4-f0d7-4010-a21c-bf693b0382d1', 'bb9c22af-b482-4cf2-869d-aa6c71845bdd', 'b0cc130b-bde2-470c-b89b-c47fdd44f733', '5d6a413b-83a3-4e3d-8dfd-b1bd2528dcbd'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b21432a3-1e73-4dd8-a711-f8b25b120a12 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b21432a3-1e73-4dd8-a711-f8b25b120a12 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b21432a3-1e73-4dd8-a711-f8b25b120a12 tempest-CreateVolumesFromSnapshotTest-230118934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:24 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b21432a3-1e73-4dd8-a711-f8b25b120a12 tempest-CreateVolumesFromSnapshotTest-230118934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b21432a3-1e73-4dd8-a711-f8b25b120a12 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b21432a3-1e73-4dd8-a711-f8b25b120a12 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:24 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:12:24 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:24 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-38a3626a-d276-4894-bcb5-2c4fe304d1cf" returned: 0 in 2.660s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:24 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb800f0-28f4-492e-a89b-43ee812c7fb4]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:24 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:24 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 Feb 27 02:12:24 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:25 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b21432a3-1e73-4dd8-a711-f8b25b120a12 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.477s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:25 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-b21432a3-1e73-4dd8-a711-f8b25b120a12 tempest-CreateVolumesFromSnapshotTest-230118934 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:25 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b21432a3-1e73-4dd8-a711-f8b25b120a12 tempest-CreateVolumesFromSnapshotTest-230118934 None] Deleted volume successfully. Feb 27 02:12:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b21432a3-1e73-4dd8-a711-f8b25b120a12 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-0bcd090d-dffe-49eb-a690-497fcfd82bb5-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b7968045-8fe0-42c1-a016-57204061121f tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "cinder-d7ce74df-dc5a-438c-843f-72ea23e44c74-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b7968045-8fe0-42c1-a016-57204061121f tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-d7ce74df-dc5a-438c-843f-72ea23e44c74-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b7968045-8fe0-42c1-a016-57204061121f tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "cinder-quobyte-d7ce74df-dc5a-438c-843f-72ea23e44c74" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:25 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b7968045-8fe0-42c1-a016-57204061121f tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-quobyte-d7ce74df-dc5a-438c-843f-72ea23e44c74" acquired by "delete_volume" :: waited 0.019s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:25 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[533f2a99-7d22-45dd-828f-ec37c4d134ec]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b7968045-8fe0-42c1-a016-57204061121f tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d7ce74df-dc5a-438c-843f-72ea23e44c74 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:25 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74" returned: 0 in 0.909s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:25 devstack cinder-volume[83167]: DEBUG cinder.image.image_utils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Image conversion details: src /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74, size 1024.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-38a3626a-d276-4894-bcb5-2c4fe304d1cf {{(pid=83167) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:12:25 devstack cinder-volume[83167]: INFO cinder.image.image_utils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Converted 1024.00 MB image at 384.74 MB/s Feb 27 02:12:25 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-38a3626a-d276-4894-bcb5-2c4fe304d1cf is being set with open permissions: ugo+rw Feb 27 02:12:25 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-38a3626a-d276-4894-bcb5-2c4fe304d1cf {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:25 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d7ce74df-dc5a-438c-843f-72ea23e44c74 Feb 27 02:12:25 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:25 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-38a3626a-d276-4894-bcb5-2c4fe304d1cf Feb 27 02:12:25 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:26 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b7968045-8fe0-42c1-a016-57204061121f tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d7ce74df-dc5a-438c-843f-72ea23e44c74" returned: 0 in 0.553s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b7968045-8fe0-42c1-a016-57204061121f tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d7ce74df-dc5a-438c-843f-72ea23e44c74 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:26 devstack sudo[91179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d7ce74df-dc5a-438c-843f-72ea23e44c74 Feb 27 02:12:26 devstack sudo[91179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:26 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-38a3626a-d276-4894-bcb5-2c4fe304d1cf" returned: 0 in 0.520s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-quobyte-38a3626a-d276-4894-bcb5-2c4fe304d1cf" released by "_copy_volume_from_snapshot" :: held 5.502s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "cinder-quobyte-365cc6b5-a681-4d77-bd76-8a5721b4f62a" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-quobyte-365cc6b5-a681-4d77-bd76-8a5721b4f62a" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Deleting offline snapshot 365cc6b5-a681-4d77-bd76-8a5721b4f62a of volume 62bd1419-46ff-4c87-a107-8e4eaae57b74 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] snapshot_file for this snap is: volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9d5e20-9d7c-4b39-98bc-7f4331a30718]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:26 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a Feb 27 02:12:26 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:26 devstack sudo[91179]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b7968045-8fe0-42c1-a016-57204061121f tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-d7ce74df-dc5a-438c-843f-72ea23e44c74" returned: 0 in 0.481s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b7968045-8fe0-42c1-a016-57204061121f tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-quobyte-d7ce74df-dc5a-438c-843f-72ea23e44c74" released by "delete_volume" :: held 1.070s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-b7968045-8fe0-42c1-a016-57204061121f tempest-CreateVolumesFromSnapshotTest-230118934 None] Created reservations ['7a8abd3a-b52c-44e7-9f11-8dd9fe04ce55', '632ffd17-266f-4e5c-a21d-d4028f5ff4fe', '7b87883f-c2c1-4280-94d9-aa3c22fe95b6', 'ff43bb5c-fd2b-4f2a-bdaa-62c93e433068'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b7968045-8fe0-42c1-a016-57204061121f tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b7968045-8fe0-42c1-a016-57204061121f tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b7968045-8fe0-42c1-a016-57204061121f tempest-CreateVolumesFromSnapshotTest-230118934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b7968045-8fe0-42c1-a016-57204061121f tempest-CreateVolumesFromSnapshotTest-230118934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b7968045-8fe0-42c1-a016-57204061121f tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b7968045-8fe0-42c1-a016-57204061121f tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:26 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:12:26 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:26 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a" returned: 0 in 0.610s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62bd1419-46ff-4c87-a107-8e4eaae57b74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9b9b7f-f5ae-4279-991a-63ddbe374228]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:26 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:26 devstack sudo[91189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 Feb 27 02:12:26 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:27 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b7968045-8fe0-42c1-a016-57204061121f tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.509s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:27 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-b7968045-8fe0-42c1-a016-57204061121f tempest-CreateVolumesFromSnapshotTest-230118934 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:27 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b7968045-8fe0-42c1-a016-57204061121f tempest-CreateVolumesFromSnapshotTest-230118934 None] Deleted volume successfully. Feb 27 02:12:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b7968045-8fe0-42c1-a016-57204061121f tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-d7ce74df-dc5a-438c-843f-72ea23e44c74-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:27 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74" returned: 0 in 0.572s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:27 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a Feb 27 02:12:27 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a766f90c-a97e-4eda-9b24-ddea4443c0b3 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "cinder-0e251407-b175-4e5e-a943-25470b3dc3b4-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a766f90c-a97e-4eda-9b24-ddea4443c0b3 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-0e251407-b175-4e5e-a943-25470b3dc3b4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a766f90c-a97e-4eda-9b24-ddea4443c0b3 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "cinder-quobyte-0e251407-b175-4e5e-a943-25470b3dc3b4" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:27 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a766f90c-a97e-4eda-9b24-ddea4443c0b3 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-quobyte-0e251407-b175-4e5e-a943-25470b3dc3b4" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:27 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2667afa-0970-4f3f-91da-1bc5205f12bd]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a766f90c-a97e-4eda-9b24-ddea4443c0b3 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e251407-b175-4e5e-a943-25470b3dc3b4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:27 devstack sudo[91198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e251407-b175-4e5e-a943-25470b3dc3b4 Feb 27 02:12:27 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:27 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a" returned: 0 in 0.570s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:27 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:27 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a Feb 27 02:12:27 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:28 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a766f90c-a97e-4eda-9b24-ddea4443c0b3 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e251407-b175-4e5e-a943-25470b3dc3b4" returned: 0 in 0.579s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a766f90c-a97e-4eda-9b24-ddea4443c0b3 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e251407-b175-4e5e-a943-25470b3dc3b4 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:28 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e251407-b175-4e5e-a943-25470b3dc3b4 Feb 27 02:12:28 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:28 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74.365cc6b5-a681-4d77-bd76-8a5721b4f62a" returned: 0 in 0.472s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-quobyte-365cc6b5-a681-4d77-bd76-8a5721b4f62a" released by "_delete_snapshot" :: held 2.278s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.073s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.869s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea022ec8-fafb-4d4e-8d98-981db3bbcbde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b7e0bfa88344e6ba33ef4f5badfa60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:08Z,use_quota=True,user_id='b287164e6e244f858e27c852d516ab8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Creating volume ea022ec8-fafb-4d4e-8d98-981db3bbcbde {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:28 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea022ec8-fafb-4d4e-8d98-981db3bbcbde 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43524b8c-8f8c-4180-aef8-3defe46d6622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38a3626a-d276-4894-bcb5-2c4fe304d1cf', 'volume_size': 1, 'source_volid': '62bd1419-46ff-4c87-a107-8e4eaae57b74', 'source_volstatus': 'available'}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171f1013-c17b-4caf-9941-1b474440f740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:28 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Volume volume-38a3626a-d276-4894-bcb5-2c4fe304d1cf (38a3626a-d276-4894-bcb5-2c4fe304d1cf): created successfully Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171f1013-c17b-4caf-9941-1b474440f740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Flow 'volume_create_manager' (4b72a93c-e580-4b97-9301-243764aab20b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:28 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea022ec8-fafb-4d4e-8d98-981db3bbcbde 1073741824 Feb 27 02:12:28 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:28 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b1705a60-adba-41a9-83b0-c1d347692e5a tempest-VolumeDependencyTests-1616200110 None] Created volume successfully. Feb 27 02:12:28 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a766f90c-a97e-4eda-9b24-ddea4443c0b3 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-0e251407-b175-4e5e-a943-25470b3dc3b4" returned: 0 in 0.443s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a766f90c-a97e-4eda-9b24-ddea4443c0b3 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-quobyte-0e251407-b175-4e5e-a943-25470b3dc3b4" released by "delete_volume" :: held 1.047s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-a766f90c-a97e-4eda-9b24-ddea4443c0b3 tempest-CreateVolumesFromSnapshotTest-230118934 None] Created reservations ['031c075a-78f1-4e0d-ba72-63ddd2c79181', '731c0425-920f-4737-a28a-3bfd984b4e26', '21b639b9-1406-439e-bcb2-569e4f916ff3', '0c687c7b-8465-4646-ac95-261a13f35346'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a766f90c-a97e-4eda-9b24-ddea4443c0b3 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a766f90c-a97e-4eda-9b24-ddea4443c0b3 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a766f90c-a97e-4eda-9b24-ddea4443c0b3 tempest-CreateVolumesFromSnapshotTest-230118934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-a766f90c-a97e-4eda-9b24-ddea4443c0b3 tempest-CreateVolumesFromSnapshotTest-230118934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-a766f90c-a97e-4eda-9b24-ddea4443c0b3 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:28 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a766f90c-a97e-4eda-9b24-ddea4443c0b3 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:28 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:12:28 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:29 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea022ec8-fafb-4d4e-8d98-981db3bbcbde 1073741824" returned: 0 in 0.599s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea022ec8-fafb-4d4e-8d98-981db3bbcbde {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:29 devstack sudo[91221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea022ec8-fafb-4d4e-8d98-981db3bbcbde Feb 27 02:12:29 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:29 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-a766f90c-a97e-4eda-9b24-ddea4443c0b3 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.449s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-a766f90c-a97e-4eda-9b24-ddea4443c0b3 tempest-CreateVolumesFromSnapshotTest-230118934 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:29 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-a766f90c-a97e-4eda-9b24-ddea4443c0b3 tempest-CreateVolumesFromSnapshotTest-230118934 None] Deleted volume successfully. Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-a766f90c-a97e-4eda-9b24-ddea4443c0b3 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-0e251407-b175-4e5e-a943-25470b3dc3b4-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b2963ccb-517f-42e5-ad5c-4f784e5a3c65 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "cinder-62bd1419-46ff-4c87-a107-8e4eaae57b74-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b2963ccb-517f-42e5-ad5c-4f784e5a3c65 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-62bd1419-46ff-4c87-a107-8e4eaae57b74-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:29 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea022ec8-fafb-4d4e-8d98-981db3bbcbde" returned: 0 in 0.562s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca955e6-4328-42b8-8256-5995ff606ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea022ec8-fafb-4d4e-8d98-981db3bbcbde', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d767c54d-00e0-45ab-a971-466af239205b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b2963ccb-517f-42e5-ad5c-4f784e5a3c65 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "cinder-quobyte-62bd1419-46ff-4c87-a107-8e4eaae57b74" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:29 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Volume volume-ea022ec8-fafb-4d4e-8d98-981db3bbcbde (ea022ec8-fafb-4d4e-8d98-981db3bbcbde): created successfully Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d767c54d-00e0-45ab-a971-466af239205b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Flow 'volume_create_manager' (a3612c18-e1a1-455f-bbd0-40a4e10d5d3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:29 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-9412b98d-28ce-4399-85e5-59809e74b3c9 tempest-CinderUnicodeTest-1372267804 None] Created volume successfully. Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b2963ccb-517f-42e5-ad5c-4f784e5a3c65 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-quobyte-62bd1419-46ff-4c87-a107-8e4eaae57b74" acquired by "delete_volume" :: waited 0.027s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[b993e9db-d53b-4e9d-96f2-fc722d404a9d]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b2963ccb-517f-42e5-ad5c-4f784e5a3c65 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:29 devstack sudo[91225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 Feb 27 02:12:29 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "cinder-d271f44a-5384-41bc-a233-cbe79f340a72-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-d271f44a-5384-41bc-a233-cbe79f340a72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "cinder-quobyte-a5b36900-08fd-4b20-978a-1b2902b5f4dd" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-quobyte-a5b36900-08fd-4b20-978a-1b2902b5f4dd" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "cinder-quobyte-d271f44a-5384-41bc-a233-cbe79f340a72" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-quobyte-d271f44a-5384-41bc-a233-cbe79f340a72" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] Deleting offline snapshot d271f44a-5384-41bc-a233-cbe79f340a72 of volume a5b36900-08fd-4b20-978a-1b2902b5f4dd {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] snapshot_file for this snap is: volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.d271f44a-5384-41bc-a233-cbe79f340a72 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf8e116-0ba0-4f5a-9b1d-8bb2ef162c31]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:29 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.d271f44a-5384-41bc-a233-cbe79f340a72 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:30 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.d271f44a-5384-41bc-a233-cbe79f340a72 Feb 27 02:12:30 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83167) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Flow 'volume_create_manager' (bf182961-095b-4080-8951-b9c9e30e1994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c9ec2a-61ce-44e8-960d-72f7a723a29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c9ec2a-61ce-44e8-960d-72f7a723a29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-692656276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6870a9-2568-45b0-baec-30fad8750ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b7e0bfa88344e6ba33ef4f5badfa60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:30Z,use_quota=True,user_id='b287164e6e244f858e27c852d516ab8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c9506b-2834-43c6-b24b-dfef18e0b052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c9506b-2834-43c6-b24b-dfef18e0b052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e79c69-2c55-48cc-9010-1b5264c8fea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e79c69-2c55-48cc-9010-1b5264c8fea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef6870a9-2568-45b0-baec-30fad8750ab8', 'volume_name': 'volume-ef6870a9-2568-45b0-baec-30fad8750ab8', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:30 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0c6ca3-2eb3-473b-9e16-deedda81836f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0c6ca3-2eb3-473b-9e16-deedda81836f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2cc0e7-f0b5-45cd-a31d-002adc5a4333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:30 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Volume ef6870a9-2568-45b0-baec-30fad8750ab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef6870a9-2568-45b0-baec-30fad8750ab8', 'volume_size': 1} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:12:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-692656276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6870a9-2568-45b0-baec-30fad8750ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b7e0bfa88344e6ba33ef4f5badfa60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:12:30Z,use_quota=True,user_id='b287164e6e244f858e27c852d516ab8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02a7a128-170e-47f4-a08f-073ebd1275b7),volume_type_id=02a7a128-170e-47f4-a08f-073ebd1275b7)}" {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Creating volume ef6870a9-2568-45b0-baec-30fad8750ab8 {{(pid=83167) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Selected osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb as target Quobyte volume. {{(pid=83167) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:12:30 devstack cinder-volume[83167]: INFO cinder.volume.drivers.remotefs [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] casted to osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8 1073741824 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b2963ccb-517f-42e5-ad5c-4f784e5a3c65 tempest-VolumeDependencyTests-1616200110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74" returned: 0 in 0.684s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b2963ccb-517f-42e5-ad5c-4f784e5a3c65 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:30 devstack sudo[91235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8 1073741824 Feb 27 02:12:30 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:30 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74 Feb 27 02:12:30 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:30 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.d271f44a-5384-41bc-a233-cbe79f340a72" returned: 0 in 0.557s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d76d46-8c28-4c98-953b-a93ba291280d]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:30 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd Feb 27 02:12:30 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:30 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b2963ccb-517f-42e5-ad5c-4f784e5a3c65 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-62bd1419-46ff-4c87-a107-8e4eaae57b74" returned: 0 in 0.434s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b2963ccb-517f-42e5-ad5c-4f784e5a3c65 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-quobyte-62bd1419-46ff-4c87-a107-8e4eaae57b74" released by "delete_volume" :: held 1.153s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-b2963ccb-517f-42e5-ad5c-4f784e5a3c65 tempest-VolumeDependencyTests-1616200110 None] Created reservations ['7e2111fe-1c55-4b2d-a411-fbe8de4d5e03', '5e774d49-4303-4c17-a24a-f07c92926267', '080801ea-c30e-456f-8847-6d19b45d8490', 'be445e7e-1fb5-4ceb-b3d7-527b7bbb4267'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_service.periodic_task [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83167) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:30 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8 1073741824" returned: 0 in 0.543s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:30 devstack sudo[91248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:12:30 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b2963ccb-517f-42e5-ad5c-4f784e5a3c65 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b2963ccb-517f-42e5-ad5c-4f784e5a3c65 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b2963ccb-517f-42e5-ad5c-4f784e5a3c65 tempest-VolumeDependencyTests-1616200110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-b2963ccb-517f-42e5-ad5c-4f784e5a3c65 tempest-VolumeDependencyTests-1616200110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-b2963ccb-517f-42e5-ad5c-4f784e5a3c65 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:30 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b2963ccb-517f-42e5-ad5c-4f784e5a3c65 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:30 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8 Feb 27 02:12:30 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:31 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd" returned: 0 in 0.500s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.d271f44a-5384-41bc-a233-cbe79f340a72 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:31 devstack sudo[91251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:12:31 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:31 devstack sudo[91254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.d271f44a-5384-41bc-a233-cbe79f340a72 Feb 27 02:12:31 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:31 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.443s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-68b1fda2-0862-4b53-a1ec-b2f9b36ff55f None None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:31 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8" returned: 0 in 0.450s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'} {{(pid=83167) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:31 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2cc0e7-f0b5-45cd-a31d-002adc5a4333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef6870a9-2568-45b0-baec-30fad8750ab8', 'volume_size': 1}' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2904db1-5a5c-4bab-ae0d-bfe317c8afa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-b2963ccb-517f-42e5-ad5c-4f784e5a3c65 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.457s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-b2963ccb-517f-42e5-ad5c-4f784e5a3c65 tempest-VolumeDependencyTests-1616200110 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:31 devstack cinder-volume[83167]: INFO cinder.volume.flows.manager.create_volume [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Volume volume-ef6870a9-2568-45b0-baec-30fad8750ab8 (ef6870a9-2568-45b0-baec-30fad8750ab8): created successfully Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2904db1-5a5c-4bab-ae0d-bfe317c8afa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83167) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG cinder.volume.manager [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Flow 'volume_create_manager' (bf182961-095b-4080-8951-b9c9e30e1994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83167) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:31 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-b2963ccb-517f-42e5-ad5c-4f784e5a3c65 tempest-VolumeDependencyTests-1616200110 None] Deleted volume successfully. Feb 27 02:12:31 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-5f9a6f7b-babe-4db5-88be-3e4702a6633a tempest-CinderUnicodeTest-1372267804 None] Created volume successfully. Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-b2963ccb-517f-42e5-ad5c-4f784e5a3c65 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-62bd1419-46ff-4c87-a107-8e4eaae57b74-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:31 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.d271f44a-5384-41bc-a233-cbe79f340a72" returned: 0 in 0.485s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.d271f44a-5384-41bc-a233-cbe79f340a72 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:31 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.d271f44a-5384-41bc-a233-cbe79f340a72 Feb 27 02:12:31 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dcd13042-5583-4106-a5c4-5d6c8e90a6c5 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "cinder-38a3626a-d276-4894-bcb5-2c4fe304d1cf-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dcd13042-5583-4106-a5c4-5d6c8e90a6c5 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-38a3626a-d276-4894-bcb5-2c4fe304d1cf-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dcd13042-5583-4106-a5c4-5d6c8e90a6c5 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "cinder-quobyte-38a3626a-d276-4894-bcb5-2c4fe304d1cf" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dcd13042-5583-4106-a5c4-5d6c8e90a6c5 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-quobyte-38a3626a-d276-4894-bcb5-2c4fe304d1cf" acquired by "delete_volume" :: waited 0.012s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[88449d16-c659-4e1f-bf96-0d1c2abad209]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dcd13042-5583-4106-a5c4-5d6c8e90a6c5 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-38a3626a-d276-4894-bcb5-2c4fe304d1cf {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:31 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-38a3626a-d276-4894-bcb5-2c4fe304d1cf Feb 27 02:12:31 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:31 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd.d271f44a-5384-41bc-a233-cbe79f340a72" returned: 0 in 0.459s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-quobyte-d271f44a-5384-41bc-a233-cbe79f340a72" released by "_delete_snapshot" :: held 2.103s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:31 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-quobyte-a5b36900-08fd-4b20-978a-1b2902b5f4dd" released by "delete_snapshot" :: held 2.116s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:32 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] Created reservations ['664bae23-8e68-4aeb-b3fa-46db7ed94ea2', '184742d1-0bae-4207-8fff-126206d442b1', '885acf77-5bde-4786-a63d-741ef62f70ab', '21605433-ab88-41fa-ada2-99e165cb9d54'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:32 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] Delete snapshot completed successfully. Feb 27 02:12:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-ea48ad4a-b288-4324-b7ae-a3d1f7cf2ed4 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-d271f44a-5384-41bc-a233-cbe79f340a72-delete_snapshot" released by "delete_snapshot" :: held 2.228s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:32 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dcd13042-5583-4106-a5c4-5d6c8e90a6c5 tempest-VolumeDependencyTests-1616200110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-38a3626a-d276-4894-bcb5-2c4fe304d1cf" returned: 0 in 0.469s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dcd13042-5583-4106-a5c4-5d6c8e90a6c5 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-38a3626a-d276-4894-bcb5-2c4fe304d1cf {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:32 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-38a3626a-d276-4894-bcb5-2c4fe304d1cf Feb 27 02:12:32 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cdd0ffc3-3744-49b1-9ca0-a367b3e3008d tempest-CinderUnicodeTest-1372267804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cdd0ffc3-3744-49b1-9ca0-a367b3e3008d tempest-CinderUnicodeTest-1372267804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-cdd0ffc3-3744-49b1-9ca0-a367b3e3008d tempest-CinderUnicodeTest-1372267804 None] Creating offline snapshot 833f2e15-fd2f-462a-9394-c708fa2b6adf of volume ef6870a9-2568-45b0-baec-30fad8750ab8 {{(pid=83167) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:12:32 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[503f236c-12d6-4fe0-8948-6b0cebf17b62]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cdd0ffc3-3744-49b1-9ca0-a367b3e3008d tempest-CinderUnicodeTest-1372267804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:32 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8 Feb 27 02:12:32 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:32 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dcd13042-5583-4106-a5c4-5d6c8e90a6c5 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-38a3626a-d276-4894-bcb5-2c4fe304d1cf" returned: 0 in 0.431s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dcd13042-5583-4106-a5c4-5d6c8e90a6c5 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-quobyte-38a3626a-d276-4894-bcb5-2c4fe304d1cf" released by "delete_volume" :: held 0.926s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:32 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-dcd13042-5583-4106-a5c4-5d6c8e90a6c5 tempest-VolumeDependencyTests-1616200110 None] Created reservations ['a01dc57c-c40f-401c-a9fd-2220f30d6cbd', 'db6da794-d728-438b-8955-56a92dbf56ab', '0e90f427-1694-43ed-b2f1-561b13b5375b', '317f1ae1-c515-45db-a28f-825c86631474'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dcd13042-5583-4106-a5c4-5d6c8e90a6c5 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dcd13042-5583-4106-a5c4-5d6c8e90a6c5 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dcd13042-5583-4106-a5c4-5d6c8e90a6c5 tempest-VolumeDependencyTests-1616200110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:32 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-dcd13042-5583-4106-a5c4-5d6c8e90a6c5 tempest-VolumeDependencyTests-1616200110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-dcd13042-5583-4106-a5c4-5d6c8e90a6c5 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:32 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dcd13042-5583-4106-a5c4-5d6c8e90a6c5 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:32 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:12:32 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-69af31bf-d93f-4074-98e3-41660904a926 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "cinder-ae7a189c-6467-4291-baff-555af820fe31-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:32 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-69af31bf-d93f-4074-98e3-41660904a926 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-ae7a189c-6467-4291-baff-555af820fe31-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-78ad53ac-61a7-4b89-b9b8-5b49be3f3453 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "cinder-a5b36900-08fd-4b20-978a-1b2902b5f4dd-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-78ad53ac-61a7-4b89-b9b8-5b49be3f3453 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-a5b36900-08fd-4b20-978a-1b2902b5f4dd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-69af31bf-d93f-4074-98e3-41660904a926 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "cinder-quobyte-ae7a189c-6467-4291-baff-555af820fe31" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-78ad53ac-61a7-4b89-b9b8-5b49be3f3453 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "cinder-quobyte-a5b36900-08fd-4b20-978a-1b2902b5f4dd" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-69af31bf-d93f-4074-98e3-41660904a926 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-quobyte-ae7a189c-6467-4291-baff-555af820fe31" acquired by "delete_volume" :: waited 0.024s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-78ad53ac-61a7-4b89-b9b8-5b49be3f3453 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-quobyte-a5b36900-08fd-4b20-978a-1b2902b5f4dd" acquired by "delete_volume" :: waited 0.024s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd8d8d3-ca53-46bb-8080-487b34b4b0d7]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-69af31bf-d93f-4074-98e3-41660904a926 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ae7a189c-6467-4291-baff-555af820fe31 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[161feb7c-dd34-4333-b8f5-af04593efb53]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-78ad53ac-61a7-4b89-b9b8-5b49be3f3453 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:33 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cdd0ffc3-3744-49b1-9ca0-a367b3e3008d tempest-CinderUnicodeTest-1372267804 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8" returned: 0 in 0.521s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cdd0ffc3-3744-49b1-9ca0-a367b3e3008d tempest-CinderUnicodeTest-1372267804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.833f2e15-fd2f-462a-9394-c708fa2b6adf 1G {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:33 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ae7a189c-6467-4291-baff-555af820fe31 Feb 27 02:12:33 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:33 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.833f2e15-fd2f-462a-9394-c708fa2b6adf 1G Feb 27 02:12:33 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:33 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd Feb 27 02:12:33 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:33 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-dcd13042-5583-4106-a5c4-5d6c8e90a6c5 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.481s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-dcd13042-5583-4106-a5c4-5d6c8e90a6c5 tempest-VolumeDependencyTests-1616200110 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:33 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-dcd13042-5583-4106-a5c4-5d6c8e90a6c5 tempest-VolumeDependencyTests-1616200110 None] Deleted volume successfully. Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-dcd13042-5583-4106-a5c4-5d6c8e90a6c5 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-38a3626a-d276-4894-bcb5-2c4fe304d1cf-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:33 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:33 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-69af31bf-d93f-4074-98e3-41660904a926 tempest-VolumeDependencyTests-1616200110 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ae7a189c-6467-4291-baff-555af820fe31" returned: 0 in 0.550s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-69af31bf-d93f-4074-98e3-41660904a926 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ae7a189c-6467-4291-baff-555af820fe31 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-78ad53ac-61a7-4b89-b9b8-5b49be3f3453 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd" returned: 0 in 0.547s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-78ad53ac-61a7-4b89-b9b8-5b49be3f3453 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:33 devstack sudo[91296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ae7a189c-6467-4291-baff-555af820fe31 Feb 27 02:12:33 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:33 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd Feb 27 02:12:33 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:33 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cdd0ffc3-3744-49b1-9ca0-a367b3e3008d tempest-CinderUnicodeTest-1372267804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.833f2e15-fd2f-462a-9394-c708fa2b6adf 1G" returned: 0 in 0.533s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:33 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cdd0ffc3-3744-49b1-9ca0-a367b3e3008d tempest-CinderUnicodeTest-1372267804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef6870a9-2568-45b0-baec-30fad8750ab8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.833f2e15-fd2f-462a-9394-c708fa2b6adf {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:33 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef6870a9-2568-45b0-baec-30fad8750ab8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.833f2e15-fd2f-462a-9394-c708fa2b6adf Feb 27 02:12:33 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:34 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-69af31bf-d93f-4074-98e3-41660904a926 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ae7a189c-6467-4291-baff-555af820fe31" returned: 0 in 0.426s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-69af31bf-d93f-4074-98e3-41660904a926 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-quobyte-ae7a189c-6467-4291-baff-555af820fe31" released by "delete_volume" :: held 1.026s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:34 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-78ad53ac-61a7-4b89-b9b8-5b49be3f3453 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-a5b36900-08fd-4b20-978a-1b2902b5f4dd" returned: 0 in 0.448s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-78ad53ac-61a7-4b89-b9b8-5b49be3f3453 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-quobyte-a5b36900-08fd-4b20-978a-1b2902b5f4dd" released by "delete_volume" :: held 1.043s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-69af31bf-d93f-4074-98e3-41660904a926 tempest-VolumeDependencyTests-1616200110 None] Created reservations ['4d5a40b2-fb3a-4270-ac54-92bd67b28c62', '20e0316b-2b3b-48ec-b142-ee46cbda8dcb', 'eb3f5cca-66c5-49bd-ab33-d347fa03b36c', 'b5440153-1c7c-4831-acfe-80e5f63d60f8'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-78ad53ac-61a7-4b89-b9b8-5b49be3f3453 tempest-CreateVolumesFromSnapshotTest-230118934 None] Created reservations ['ed2de594-a258-41e7-bcc6-cf9f9a8545e6', '7cc4a068-078f-4fcf-bac2-9bcca9d8c390', 'e25ca24a-e5e3-480d-ac9a-bec576199389', 'c4086531-1150-46fc-9fa4-836a086668ec'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:34 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cdd0ffc3-3744-49b1-9ca0-a367b3e3008d tempest-CinderUnicodeTest-1372267804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef6870a9-2568-45b0-baec-30fad8750ab8 -F qcow2 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.833f2e15-fd2f-462a-9394-c708fa2b6adf" returned: 0 in 0.493s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:34 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-cdd0ffc3-3744-49b1-9ca0-a367b3e3008d tempest-CinderUnicodeTest-1372267804 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.833f2e15-fd2f-462a-9394-c708fa2b6adf is being set with open permissions: ugo+rw Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cdd0ffc3-3744-49b1-9ca0-a367b3e3008d tempest-CinderUnicodeTest-1372267804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.833f2e15-fd2f-462a-9394-c708fa2b6adf {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:34 devstack sudo[91313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.833f2e15-fd2f-462a-9394-c708fa2b6adf Feb 27 02:12:34 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-69af31bf-d93f-4074-98e3-41660904a926 tempest-VolumeDependencyTests-1616200110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-69af31bf-d93f-4074-98e3-41660904a926 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-69af31bf-d93f-4074-98e3-41660904a926 tempest-VolumeDependencyTests-1616200110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-69af31bf-d93f-4074-98e3-41660904a926 tempest-VolumeDependencyTests-1616200110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-69af31bf-d93f-4074-98e3-41660904a926 tempest-VolumeDependencyTests-1616200110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-69af31bf-d93f-4074-98e3-41660904a926 tempest-VolumeDependencyTests-1616200110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-78ad53ac-61a7-4b89-b9b8-5b49be3f3453 tempest-CreateVolumesFromSnapshotTest-230118934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-78ad53ac-61a7-4b89-b9b8-5b49be3f3453 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-78ad53ac-61a7-4b89-b9b8-5b49be3f3453 tempest-CreateVolumesFromSnapshotTest-230118934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-78ad53ac-61a7-4b89-b9b8-5b49be3f3453 tempest-CreateVolumesFromSnapshotTest-230118934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-78ad53ac-61a7-4b89-b9b8-5b49be3f3453 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:34 devstack sudo[91315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-78ad53ac-61a7-4b89-b9b8-5b49be3f3453 tempest-CreateVolumesFromSnapshotTest-230118934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:34 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:34 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:12:34 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:34 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cdd0ffc3-3744-49b1-9ca0-a367b3e3008d tempest-CinderUnicodeTest-1372267804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.833f2e15-fd2f-462a-9394-c708fa2b6adf" returned: 0 in 0.412s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cdd0ffc3-3744-49b1-9ca0-a367b3e3008d tempest-CinderUnicodeTest-1372267804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:34 devstack sudo[91322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.info Feb 27 02:12:34 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:34 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-69af31bf-d93f-4074-98e3-41660904a926 tempest-VolumeDependencyTests-1616200110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.439s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-69af31bf-d93f-4074-98e3-41660904a926 tempest-VolumeDependencyTests-1616200110 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:34 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-69af31bf-d93f-4074-98e3-41660904a926 tempest-VolumeDependencyTests-1616200110 None] Deleted volume successfully. Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-69af31bf-d93f-4074-98e3-41660904a926 tempest-VolumeDependencyTests-1616200110 None] Lock "cinder-ae7a189c-6467-4291-baff-555af820fe31-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:34 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-78ad53ac-61a7-4b89-b9b8-5b49be3f3453 tempest-CreateVolumesFromSnapshotTest-230118934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.454s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-78ad53ac-61a7-4b89-b9b8-5b49be3f3453 tempest-CreateVolumesFromSnapshotTest-230118934 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:34 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-78ad53ac-61a7-4b89-b9b8-5b49be3f3453 tempest-CreateVolumesFromSnapshotTest-230118934 None] Deleted volume successfully. Feb 27 02:12:34 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-78ad53ac-61a7-4b89-b9b8-5b49be3f3453 tempest-CreateVolumesFromSnapshotTest-230118934 None] Lock "cinder-a5b36900-08fd-4b20-978a-1b2902b5f4dd-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:35 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cdd0ffc3-3744-49b1-9ca0-a367b3e3008d tempest-CinderUnicodeTest-1372267804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.info" returned: 0 in 0.409s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:35 devstack cinder-volume[83167]: WARNING cinder.volume.drivers.remotefs [None req-cdd0ffc3-3744-49b1-9ca0-a367b3e3008d tempest-CinderUnicodeTest-1372267804 None] /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.info is being set with open permissions: ugo+rw Feb 27 02:12:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cdd0ffc3-3744-49b1-9ca0-a367b3e3008d tempest-CinderUnicodeTest-1372267804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.info {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:35 devstack sudo[91325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.info Feb 27 02:12:35 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:35 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-cdd0ffc3-3744-49b1-9ca0-a367b3e3008d tempest-CinderUnicodeTest-1372267804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.info" returned: 0 in 0.464s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-cdd0ffc3-3744-49b1-9ca0-a367b3e3008d tempest-CinderUnicodeTest-1372267804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.902s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:35 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-cdd0ffc3-3744-49b1-9ca0-a367b3e3008d tempest-CinderUnicodeTest-1372267804 None] Create snapshot completed successfully Feb 27 02:12:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] Acquiring lock "cinder-833f2e15-fd2f-462a-9394-c708fa2b6adf-delete_snapshot" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] Lock "cinder-833f2e15-fd2f-462a-9394-c708fa2b6adf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] Acquiring lock "cinder-quobyte-ef6870a9-2568-45b0-baec-30fad8750ab8" by "delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] Lock "cinder-quobyte-ef6870a9-2568-45b0-baec-30fad8750ab8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] Acquiring lock "cinder-quobyte-833f2e15-fd2f-462a-9394-c708fa2b6adf" by "_delete_snapshot" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:35 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] Lock "cinder-quobyte-833f2e15-fd2f-462a-9394-c708fa2b6adf" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] Deleting offline snapshot 833f2e15-fd2f-462a-9394-c708fa2b6adf of volume ef6870a9-2568-45b0-baec-30fad8750ab8 {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:12:35 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] snapshot_file for this snap is: volume-ef6870a9-2568-45b0-baec-30fad8750ab8.833f2e15-fd2f-462a-9394-c708fa2b6adf {{(pid=83167) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:12:35 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[810e0e91-437e-4678-8620-50aa93db0b99]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:35 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.833f2e15-fd2f-462a-9394-c708fa2b6adf {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:36 devstack sudo[91329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.833f2e15-fd2f-462a-9394-c708fa2b6adf Feb 27 02:12:36 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:36 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.833f2e15-fd2f-462a-9394-c708fa2b6adf" returned: 0 in 0.580s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:36 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.remotefs [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef6870a9-2568-45b0-baec-30fad8750ab8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83167) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:12:36 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[d572a14a-e1a4-4e03-ae02-066a3b06ceeb]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:36 devstack sudo[91334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8 Feb 27 02:12:36 devstack sudo[91334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:36 devstack sudo[91334]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8" returned: 0 in 0.469s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:36 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.833f2e15-fd2f-462a-9394-c708fa2b6adf {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:37 devstack sudo[91371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.833f2e15-fd2f-462a-9394-c708fa2b6adf Feb 27 02:12:37 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:37 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.833f2e15-fd2f-462a-9394-c708fa2b6adf" returned: 0 in 0.441s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.833f2e15-fd2f-462a-9394-c708fa2b6adf {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:37 devstack sudo[91378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.833f2e15-fd2f-462a-9394-c708fa2b6adf Feb 27 02:12:37 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:37 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:37 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8.833f2e15-fd2f-462a-9394-c708fa2b6adf" returned: 0 in 0.409s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] Lock "cinder-quobyte-833f2e15-fd2f-462a-9394-c708fa2b6adf" released by "_delete_snapshot" :: held 1.963s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] Lock "cinder-quobyte-ef6870a9-2568-45b0-baec-30fad8750ab8" released by "delete_snapshot" :: held 1.978s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:37 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] Created reservations ['05bca3a3-e61a-4c8a-8af5-f92f52466b6a', '8e9ef6fa-af11-4aa3-9d1e-68c9d2bee957', '31c7c72a-2a41-404c-a261-84bb688d6169', '6a2bb11f-8090-4869-b0b9-938371f2cdba'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:37 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] Delete snapshot completed successfully. Feb 27 02:12:37 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-82b1a8ef-6d69-47e2-a2d6-bd8b70adea65 tempest-CinderUnicodeTest-1372267804 None] Lock "cinder-833f2e15-fd2f-462a-9394-c708fa2b6adf-delete_snapshot" released by "delete_snapshot" :: held 2.107s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-025024fa-bff4-4f2c-b0f7-25f8389bb761 tempest-CinderUnicodeTest-1372267804 None] Acquiring lock "cinder-ef6870a9-2568-45b0-baec-30fad8750ab8-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:38 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-025024fa-bff4-4f2c-b0f7-25f8389bb761 tempest-CinderUnicodeTest-1372267804 None] Lock "cinder-ef6870a9-2568-45b0-baec-30fad8750ab8-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-025024fa-bff4-4f2c-b0f7-25f8389bb761 tempest-CinderUnicodeTest-1372267804 None] Acquiring lock "cinder-quobyte-ef6870a9-2568-45b0-baec-30fad8750ab8" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-025024fa-bff4-4f2c-b0f7-25f8389bb761 tempest-CinderUnicodeTest-1372267804 None] Lock "cinder-quobyte-ef6870a9-2568-45b0-baec-30fad8750ab8" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:39 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[702f4311-c05e-4f23-ac7d-0537cf3ec9b8]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-025024fa-bff4-4f2c-b0f7-25f8389bb761 tempest-CinderUnicodeTest-1372267804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:39 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8 Feb 27 02:12:39 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:39 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-025024fa-bff4-4f2c-b0f7-25f8389bb761 tempest-CinderUnicodeTest-1372267804 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8" returned: 0 in 0.541s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-025024fa-bff4-4f2c-b0f7-25f8389bb761 tempest-CinderUnicodeTest-1372267804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:39 devstack sudo[91387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8 Feb 27 02:12:39 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:39 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:39 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-025024fa-bff4-4f2c-b0f7-25f8389bb761 tempest-CinderUnicodeTest-1372267804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ef6870a9-2568-45b0-baec-30fad8750ab8" returned: 0 in 0.401s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:39 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-025024fa-bff4-4f2c-b0f7-25f8389bb761 tempest-CinderUnicodeTest-1372267804 None] Lock "cinder-quobyte-ef6870a9-2568-45b0-baec-30fad8750ab8" released by "delete_volume" :: held 0.978s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:40 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-025024fa-bff4-4f2c-b0f7-25f8389bb761 tempest-CinderUnicodeTest-1372267804 None] Created reservations ['9f4d61e2-3abe-492d-9b60-b6d84b3ab470', '3bd6836a-bdcc-4e56-9895-5c5c381fff63', 'b29bd2e4-0e2b-42ed-98d4-8d54b5944b61', '75924f29-a0dd-4251-9247-eef21e179281'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-025024fa-bff4-4f2c-b0f7-25f8389bb761 tempest-CinderUnicodeTest-1372267804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-025024fa-bff4-4f2c-b0f7-25f8389bb761 tempest-CinderUnicodeTest-1372267804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-025024fa-bff4-4f2c-b0f7-25f8389bb761 tempest-CinderUnicodeTest-1372267804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:40 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-025024fa-bff4-4f2c-b0f7-25f8389bb761 tempest-CinderUnicodeTest-1372267804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-025024fa-bff4-4f2c-b0f7-25f8389bb761 tempest-CinderUnicodeTest-1372267804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-025024fa-bff4-4f2c-b0f7-25f8389bb761 tempest-CinderUnicodeTest-1372267804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:40 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:12:40 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-970daa0c-463c-44f9-b475-44a5e77bd2e4 tempest-CinderUnicodeTest-1372267804 None] Acquiring lock "cinder-ea022ec8-fafb-4d4e-8d98-981db3bbcbde-delete_volume" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-970daa0c-463c-44f9-b475-44a5e77bd2e4 tempest-CinderUnicodeTest-1372267804 None] Lock "cinder-ea022ec8-fafb-4d4e-8d98-981db3bbcbde-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-970daa0c-463c-44f9-b475-44a5e77bd2e4 tempest-CinderUnicodeTest-1372267804 None] Acquiring lock "cinder-quobyte-ea022ec8-fafb-4d4e-8d98-981db3bbcbde" by "delete_volume" {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-970daa0c-463c-44f9-b475-44a5e77bd2e4 tempest-CinderUnicodeTest-1372267804 None] Lock "cinder-quobyte-ea022ec8-fafb-4d4e-8d98-981db3bbcbde" acquired by "delete_volume" :: waited 0.007s {{(pid=83167) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:40 devstack cinder-volume[83167]: DEBUG oslo.privsep.daemon [-] privsep: reply[18590ca1-c63e-41e4-bdb5-d376c601066a]: (4, 'qcow2') {{(pid=83969) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-970daa0c-463c-44f9-b475-44a5e77bd2e4 tempest-CinderUnicodeTest-1372267804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea022ec8-fafb-4d4e-8d98-981db3bbcbde {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:40 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea022ec8-fafb-4d4e-8d98-981db3bbcbde Feb 27 02:12:40 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:40 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-025024fa-bff4-4f2c-b0f7-25f8389bb761 tempest-CinderUnicodeTest-1372267804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.437s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:40 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-025024fa-bff4-4f2c-b0f7-25f8389bb761 tempest-CinderUnicodeTest-1372267804 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:40 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-025024fa-bff4-4f2c-b0f7-25f8389bb761 tempest-CinderUnicodeTest-1372267804 None] Deleted volume successfully. Feb 27 02:12:40 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-025024fa-bff4-4f2c-b0f7-25f8389bb761 tempest-CinderUnicodeTest-1372267804 None] Lock "cinder-ef6870a9-2568-45b0-baec-30fad8750ab8-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:40 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-970daa0c-463c-44f9-b475-44a5e77bd2e4 tempest-CinderUnicodeTest-1372267804 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea022ec8-fafb-4d4e-8d98-981db3bbcbde" returned: 0 in 0.468s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:40 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-970daa0c-463c-44f9-b475-44a5e77bd2e4 tempest-CinderUnicodeTest-1372267804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea022ec8-fafb-4d4e-8d98-981db3bbcbde {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:40 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea022ec8-fafb-4d4e-8d98-981db3bbcbde Feb 27 02:12:40 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:41 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-970daa0c-463c-44f9-b475-44a5e77bd2e4 tempest-CinderUnicodeTest-1372267804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576/volume-ea022ec8-fafb-4d4e-8d98-981db3bbcbde" returned: 0 in 0.413s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:41 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-970daa0c-463c-44f9-b475-44a5e77bd2e4 tempest-CinderUnicodeTest-1372267804 None] Lock "cinder-quobyte-ea022ec8-fafb-4d4e-8d98-981db3bbcbde" released by "delete_volume" :: held 0.909s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:41 devstack cinder-volume[83167]: DEBUG cinder.quota [None req-970daa0c-463c-44f9-b475-44a5e77bd2e4 tempest-CinderUnicodeTest-1372267804 None] Created reservations ['77b69713-88b6-4ef5-8978-be11edf8d9aa', '9885d7b2-6937-4b14-9497-01ca3b5dbbe4', 'ed030003-1022-4b15-be90-0d2a7e09e4ec', '302bdd43-37cd-4958-be09-8771880dd68d'] {{(pid=83167) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-970daa0c-463c-44f9-b475-44a5e77bd2e4 tempest-CinderUnicodeTest-1372267804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-970daa0c-463c-44f9-b475-44a5e77bd2e4 tempest-CinderUnicodeTest-1372267804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-970daa0c-463c-44f9-b475-44a5e77bd2e4 tempest-CinderUnicodeTest-1372267804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb': None} {{(pid=83167) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:41 devstack cinder-volume[83167]: DEBUG cinder.volume.drivers.quobyte [None req-970daa0c-463c-44f9-b475-44a5e77bd2e4 tempest-CinderUnicodeTest-1372267804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afceef86-13bd-49db-80e6-fc4191895feb'] {{(pid=83167) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.lockutils [None req-970daa0c-463c-44f9-b475-44a5e77bd2e4 tempest-CinderUnicodeTest-1372267804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83167) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-970daa0c-463c-44f9-b475-44a5e77bd2e4 tempest-CinderUnicodeTest-1372267804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:41 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576 Feb 27 02:12:41 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:41 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:41 devstack cinder-volume[83167]: DEBUG oslo_concurrency.processutils [None req-970daa0c-463c-44f9-b475-44a5e77bd2e4 tempest-CinderUnicodeTest-1372267804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a883c6630e273665299c99f4826b0576" returned: 0 in 0.440s {{(pid=83167) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:41 devstack cinder-volume[83167]: DEBUG cinder.manager [None req-970daa0c-463c-44f9-b475-44a5e77bd2e4 tempest-CinderUnicodeTest-1372267804 None] Notifying Schedulers of capabilities ... {{(pid=83167) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:41 devstack cinder-volume[83167]: INFO cinder.volume.manager [None req-970daa0c-463c-44f9-b475-44a5e77bd2e4 tempest-CinderUnicodeTest-1372267804 None] Deleted volume successfully. Feb 27 02:12:41 devstack cinder-volume[83167]: DEBUG cinder.coordination [None req-970daa0c-463c-44f9-b475-44a5e77bd2e4 tempest-CinderUnicodeTest-1372267804 None] Lock "cinder-ea022ec8-fafb-4d4e-8d98-981db3bbcbde-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=83167) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:51 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=160,cinder:UPDATE=206,cinder:DELETE=15,cinder:INSERT=57 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:12:51 devstack cinder-volume[83167]: DEBUG dbcounter [-] [83167] Writing DB stats cinder:SELECT=151,cinder:INSERT=51,cinder:UPDATE=227,cinder:DELETE=20 {{(pid=83167) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}